Sep 11 22:53:51 devstack cinder-volume[76581]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 22:53:51 devstack cinder-volume[76581]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 22:53:51 devstack cinder-volume[76581]: we strongly recommend against using it for new projects. Sep 11 22:53:51 devstack cinder-volume[76581]: If you are already using Eventlet, we recommend migrating to a different Sep 11 22:53:51 devstack cinder-volume[76581]: framework. For more detail see Sep 11 22:53:51 devstack cinder-volume[76581]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 22:53:51 devstack cinder-volume[76581]: import eventlet # noqa Sep 11 22:53:54 devstack cinder-volume[76581]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:53:54 devstack cinder-volume[76581]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:53:54 devstack cinder-volume[76581]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:53:55 devstack cinder-volume[76581]: INFO dbcounter [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Registered counter for database cinder Sep 11 22:53:55 devstack cinder-volume[76581]: DEBUG oslo_db.sqlalchemy.engines [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:53:55 devstack cinder-volume[76581]: DEBUG dbcounter [-] [76581] Writer thread running {{(pid=76581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:53:55 devstack cinder-volume[76581]: INFO cinder.rpc [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 22:53:55 devstack cinder-volume[76581]: INFO cinder.rpc [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 22:53:55 devstack cinder-volume[76581]: DEBUG oslo_db.sqlalchemy.engines [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:53:55 devstack cinder-volume[76581]: INFO cinder.volume.manager [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Determined volume DB was empty at startup. Sep 11 22:53:55 devstack cinder-volume[76581]: DEBUG cinder.volume.manager [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76581) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 22:53:55 devstack cinder-volume[76581]: INFO cinder.volume.manager [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 22:53:55 devstack cinder-volume[76581]: WARNING stevedore.named [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:53:55 devstack cinder-volume[76581]: WARNING castellan.key_manager [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:53:55 devstack cinder-volume[76581]: WARNING cinder.keymgr.conf_key_mgr [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:53:55 devstack cinder-volume[76581]: DEBUG cinder.volume.drivers.lvm [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76581) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 11 22:53:55 devstack cinder-volume[76581]: DEBUG oslo_concurrency.processutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_concurrency.processutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] CMD "cinder-rtstool verify" returned: 0 in 0.429s {{(pid=76581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_db.sqlalchemy.engines [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:53:56 devstack cinder-volume[76581]: INFO cinder.rpc [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 11 22:53:56 devstack cinder-volume[76581]: INFO cinder.rpc [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 11 22:53:56 devstack cinder-volume[76581]: WARNING stevedore.named [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:53:56 devstack cinder-volume[76581]: WARNING castellan.key_manager [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:53:56 devstack cinder-volume[76581]: INFO cinder.volume.manager [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_db.sqlalchemy.engines [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:53:56 devstack cinder-volume[76581]: INFO oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Starting 1 workers Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Started child 76769 {{(pid=76581) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Full set of CONF: {{(pid=76581) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] ******************************************************************************** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Configuration options gathered from: {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] ================================================================================ {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] allow_availability_zone_fallback = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] allow_compression_on_image_upload = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76769]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] allowed_direct_url_schemes = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] api_rate_limit = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] auth_strategy = keystone {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] az_cache_duration = 3600 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_availability_zone = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_host = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_stats_polling_interval = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backup_api_class = cinder.backup.api.API {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backup_name_template = backup-%s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backup_use_same_host = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backup_use_temp_snapshot = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] chap_password = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] chap_username = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_internal_tenant_project_id = 3454e3af160044719ee0dc73031af0dd {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_internal_tenant_user_id = 0c1999cea07b44a0b36148b96b53be8c {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cloned_volume_same_az = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cluster = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] compression_format = gzip {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] compute_api_class = cinder.compute.nova.API {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] config_dir = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] config_source = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] control_exchange = openstack {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] debug = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] default_availability_zone = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] default_group_type = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] default_volume_type = lvmdriver-1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] disk_geometry = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] driver_client_cert = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] driver_client_cert_key = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] driver_data_namespace = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] driver_ssl_cert_path = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] driver_ssl_cert_verify = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] driver_use_ssl = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] enable_force_upload = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] enable_new_services = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] enable_unsupported_driver = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] enabled_backends = ['lvmdriver-1'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] enforce_multipath_for_image_xfer = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] filter_function = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_api_insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_api_ssl_compression = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_ca_certificates_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_catalog_info = image:glance:publicURL {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_num_retries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance_request_timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] goodness_function = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] graceful_shutdown_timeout = 5 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] group_api_class = cinder.group.api.API {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] host = devstack {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_compress_on_upload = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_conversion_address_space_limit = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_conversion_cpu_limit = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_conversion_disable = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_introspection_address_space_limit = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_introspection_cpu_limit = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_upload_use_cinder_backend = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_upload_use_internal_tenant = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_volume_cache_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_volume_cache_max_count = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] image_volume_cache_max_size_gb = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] init_host_max_objects_retrieval = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] instance_format = [instance: %(uuid)s] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] iscsi_target_flags = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] iscsi_write_cache = on {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] iser_helper = tgtadm {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] iser_ip_address = 192.168.122.159 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] iser_port = 3260 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76769]: INFO cinder.volume.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_color = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_config_append = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_dir = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_options = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_rotate_interval = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_rotate_interval_type = days {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] log_rotation_type = none {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] max_age = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] max_logfile_count = 30 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] max_logfile_size_mb = 200 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] max_over_subscription_ratio = 20.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] message_reap_interval = 86400 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] message_ttl = 2592000 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] migration_create_volume_timeout_secs = 300 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] monkey_patch = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] monkey_patch_modules = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] my_ip = 192.168.122.159 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] no_snapshot_gb_quota = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] num_iser_scan_tries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] num_shell_tries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] num_volume_device_scan_tries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] nvmeof_conn_info_version = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] nvmet_ns_id = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] nvmet_port_id = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_max_limit = 1000 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_volume_ext_list = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_volume_listen = 0.0.0.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_volume_listen_port = 8776 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_volume_use_ssl = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] osapi_volume_workers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] per_volume_size_limit = -1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] periodic_fuzzy_delay = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] periodic_interval = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] project_id_regex = [0-9a-f\-]+ {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] public_endpoint = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] publish_errors = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_backup_gigabytes = 1000 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_backups = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_gigabytes = 1000 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_groups = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_snapshots = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] quota_volumes = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] rate_limit_burst = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] rate_limit_except_level = CRITICAL {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] rate_limit_interval = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] reinit_driver_count = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] replication_device = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] report_discard_supported = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] report_interval = 120 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] reservation_clean_interval = 86400 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] reservation_expire = 86400 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] reserved_image_namespaces = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] reserved_percentage = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] rpc_response_timeout = 120 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] run_external_periodic_tasks = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] scst_target_driver = iscsi {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] scst_target_iqn_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_down_time = 720 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] shell_completion = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] snapshot_name_template = snapshot-%s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] snapshot_same_host = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] split_loggers = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] state_path = /opt/stack/data/cinder {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] storage_availability_zone = nova {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] storage_protocol = iSCSI {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] syslog_log_facility = LOG_USER {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] target_helper = lioadm {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] target_ip_address = 192.168.122.159 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] target_port = 3260 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] target_protocol = iscsi {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] target_secondary_ip_addresses = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] trace_flags = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] transfer_api_class = cinder.transfer.api.API {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] transport_url = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] until_refresh = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_chap_auth = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_default_quota_class = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_journal = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_json = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_multipath_for_image_xfer = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_stderr = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] use_syslog = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] verify_glance_signatures = enabled {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_api_class = cinder.volume.api.API {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_backend_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_clear = zero {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_clear_ionice = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_clear_size = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_copy_bps_limit = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_dd_blocksize = 1M {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_name_template = volume-%s {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_service_inithost_offload = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volume_usage_audit_period = month {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] zoning_mode = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_concurrency.disable_process_locking = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.auth_section = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.auth_type = password {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.auth_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.cache = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.delay_auth_decision = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.http_connect_timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.include_service_catalog = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.interface = public {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_password = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcache_username = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.region_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.service_token_roles_required = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.service_type = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.token_cache_time = 300 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.backend = dogpile.cache.null {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.backend_argument = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.backend_expiration_time = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.config_prefix = cache.oslo {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.debug_cache_backend = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.enable_retry_client = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.enable_socket_keepalive = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.expiration_time = 600 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.hashclient_retry_attempts = 2 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_dead_retry = 300 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_pool_maxsize = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_sasl_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.password = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.proxies = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.redis_db = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.redis_sentinel_service_name = mymaster {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.redis_server = localhost:6379 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.retry_attempts = 2 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.retry_delay = 0.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.socket_keepalive_count = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.socket_keepalive_idle = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.socket_keepalive_interval = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.socket_timeout = 1.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.tls_allowed_ciphers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.tls_cafile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.tls_certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.tls_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.tls_keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cache.username = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] coordination.backend_url = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.asyncio_connection = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.asyncio_slave_connection = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.backend = sqlalchemy {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.connection = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.connection_debug = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.connection_parameters = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.connection_recycle_time = 3600 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.connection_trace = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.db_inc_retry_interval = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.db_max_retries = 20 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.db_max_retry_interval = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.db_retry_interval = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.max_overflow = 50 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.max_pool_size = 5 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.max_retries = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.mysql_wsrep_sync_wait = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.pool_timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.retry_interval = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.slave_connection = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.sqlite_synchronous = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.synchronous_reader = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] database.use_db_reconnect = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_tracing.insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.connection_string = messaging:// {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.es_doc_type = notification {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.es_scroll_size = 10000 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.es_scroll_time = 2m {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.filter_error_trace = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.hmac_keys = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.sentinel_service_name = mymaster {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.socket_timeout = 0.1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.trace_requests = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler.trace_sqlalchemy = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler_jaeger.process_tags = {} {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler_jaeger.service_name_prefix = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] profiler_otlp.service_name_prefix = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.enforce_new_defaults = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.policy_default_rule = default {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.policy_file = policy.yaml {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_policy.remote_timeout = 60.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.group = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.helper_command = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] privsep_osbrick.user = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.group = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.helper_command = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] cinder_sys_admin.user = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.auth_section = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.auth_type = password {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.cafile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.collect_timing = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.send_service_user_token = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.split_loggers = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.tls_ciphers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] service_user.tls_min_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.auth_section = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.auth_type = password {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.collect_timing = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.region_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.split_loggers = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.tls_ciphers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] glance.tls_min_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.backend_availability_zone = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.chap_password = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.chap_username = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.disk_geometry = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.driver_client_cert = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.driver_client_cert_key = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.driver_data_namespace = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.driver_use_ssl = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.enable_unsupported_driver = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.extra_capabilities = {} {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.filter_function = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.goodness_function = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.iscsi_target_flags = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.iscsi_write_cache = on {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.iser_helper = tgtadm {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.iser_port = 3260 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.lvm_mirrors = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.lvm_share_target = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.lvm_type = auto {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.num_shell_tries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.nvmet_port_id = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.replication_device = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.report_discard_supported = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.reserved_percentage = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.scst_target_driver = iscsi {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.scst_target_iqn_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.storage_protocol = iSCSI {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.target_helper = tgtadm {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.target_port = 3260 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.target_protocol = iscsi {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.trace_flags = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.unique_fqdn_network = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.use_chap_auth = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_backend_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_clear = zero {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_clear_ionice = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_clear_size = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volume_group = cinder-volumes {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_reports.file_event_handler = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_reports.log_dir = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.backend_availability_zone = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.backend_host = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.chap_password = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.chap_username = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.chiscsi_conf = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.disk_geometry = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.driver_client_cert = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.driver_data_namespace = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.driver_use_ssl = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.extra_capabilities = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.filter_function = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.goodness_function = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.iser_helper = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.iser_ip_address = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.iser_port = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.iser_target_prefix = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.lvm_conf_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.lvm_mirrors = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.lvm_share_target = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.lvm_type = auto {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.num_shell_tries = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.nvmet_port_id = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.replication_device = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.report_discard_supported = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.reserved_percentage = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.scst_target_driver = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.storage_protocol = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.target_helper = lioadm {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.target_ip_address = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.target_port = 3260 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.target_protocol = iscsi {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.trace_flags = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.use_chap_auth = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_clear = zero {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_clear_size = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] lvmdriver-1.volumes_dir = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.ssl_version = {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_notifications.driver = [] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_notifications.retry = -1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] oslo_messaging_notifications.transport_url = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] key_manager.fixed_key = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.barbican_api_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.barbican_endpoint = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.barbican_endpoint_type = public {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.barbican_region_name = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.cafile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.collect_timing = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.number_of_retries = 60 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.retry_delay = 1 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.send_service_user_token = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.split_loggers = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.tls_ciphers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.tls_min_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.verify_ssl = True {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican.verify_ssl_path = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.auth_section = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.auth_type = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.cafile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.certfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.collect_timing = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.insecure = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.keyfile = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.split_loggers = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.timeout = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.tls_ciphers = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] barbican_service_user.tls_min_version = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.approle_role_id = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.approle_secret_id = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.auth_method = approle {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.auth_path = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.kv_mountpoint = secret {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.kv_path = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.kv_version = 2 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.namespace = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.root_token_id = **** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.ssl_ca_crt_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.timeout = 60.0 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.token_file = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.token_role = None {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.use_ssl = False {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:53:56 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] ******************************************************************************** {{(pid=76581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 22:53:56 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.407s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:56 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:56 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:53:56 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:57 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.321s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 22:53:57 devstack cinder-volume[76769]: INFO cinder.brick.local_dev.lvm [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:57 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:53:57 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:57 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG cinder.brick.local_dev.lvm [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76769) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 11 22:53:57 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:57 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:53:57 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:58 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.546s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:58 devstack sudo[77171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:53:58 devstack sudo[77171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:58 devstack sudo[77171]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:58 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 11 22:53:58 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:58 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.302s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:58 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:58 devstack sudo[77388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:53:58 devstack sudo[77388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:59 devstack sudo[77388]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:59 devstack sudo[77391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:53:59 devstack sudo[77391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:59 devstack sudo[77391]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:59 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:53:59 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:59 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:59 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:53:59 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:53:59 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:53:59 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:00 devstack sudo[77510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:00 devstack sudo[77510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:00 devstack sudo[77510]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:00 devstack cinder-volume[76769]: INFO cinder.volume.drivers.lvm [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:00 devstack sudo[77572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:00 devstack sudo[77572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:00 devstack sudo[77572]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:00 devstack sudo[77575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:00 devstack sudo[77575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:00 devstack sudo[77575]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:00 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:00 devstack sudo[77584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:00 devstack sudo[77584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:01 devstack sudo[77584]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:01 devstack sudo[77587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:01 devstack sudo[77587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:01 devstack sudo[77587]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:01 devstack sudo[77590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:01 devstack sudo[77590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:01 devstack sudo[77590]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:01 devstack cinder-volume[76769]: INFO cinder.volume.driver [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG cinder.volume.driver [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76769) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_db.sqlalchemy.engines [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG dbcounter [-] [76769] Writer thread running {{(pid=76769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG cinder.db.api [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Building query based on filter {{(pid=76769) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG cinder.image.image_utils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76769) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 22:54:01 devstack cinder-volume[76769]: INFO cinder.keymgr.migration [None req-0406b2bd-00e2-4ad8-831b-25e50444efd3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:54:01 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:01 devstack sudo[77594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:01 devstack sudo[77594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:02 devstack sudo[77594]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:02 devstack sudo[77597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:02 devstack sudo[77597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:02 devstack sudo[77597]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:02 devstack sudo[77601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:02 devstack sudo[77601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:02 devstack sudo[77601]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:02 devstack sudo[77605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:02 devstack sudo[77605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:02 devstack sudo[77605]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG cinder.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Notifying Schedulers of capabilities ... {{(pid=76769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:54:02 devstack cinder-volume[76769]: INFO cinder.volume.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Driver initialization completed successfully. Sep 11 22:54:02 devstack cinder-volume[76769]: INFO cinder.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Initiating service 2 cleanup Sep 11 22:54:02 devstack cinder-volume[76769]: INFO cinder.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Service 2 cleanup completed. Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG cinder.service [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Creating RPC server for service cinder-volume {{(pid=76769) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 22:54:02 devstack cinder-volume[76769]: DEBUG cinder.service [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76769) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 22:54:03 devstack cinder-volume[76769]: INFO cinder.volume.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:03 devstack sudo[77609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:03 devstack sudo[77609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:03 devstack sudo[77609]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:03 devstack sudo[77612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:03 devstack sudo[77612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:03 devstack sudo[77612]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:03 devstack sudo[77617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:03 devstack sudo[77617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:03 devstack sudo[77617]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:03 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:03 devstack sudo[77623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:03 devstack sudo[77623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:04 devstack sudo[77623]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:04 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:04 devstack cinder-volume[76769]: INFO cinder.volume.manager [None req-39edb825-b597-49d4-b0a1-84b86d008982 None None] Driver post RPC initialization completed successfully. Sep 11 22:54:06 devstack cinder-volume[76581]: DEBUG dbcounter [-] [76581] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:54:07 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager._thread_info {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:54:07 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread count: 6 {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:54:07 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread info: [<_MainThread(MainThread, started 135345251610752)>, , , , , ] {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:54:14 devstack cinder-volume[76769]: DEBUG dbcounter [-] [76769] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:54:14 devstack cinder-volume[76769]: DEBUG dbcounter [-] [76769] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:07 devstack sudo[79678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:55:07 devstack sudo[79678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:07 devstack sudo[79678]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:07 devstack sudo[79681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:55:07 devstack sudo[79681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:07 devstack sudo[79681]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:07 devstack sudo[79684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:55:07 devstack sudo[79684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:07 devstack sudo[79684]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:07 devstack sudo[79687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:55:07 devstack sudo[79687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:08 devstack sudo[79687]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:08 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:08 devstack cinder-volume[76769]: DEBUG cinder.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Notifying Schedulers of capabilities ... {{(pid=76769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:55:08 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager._thread_info {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:55:08 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread count: 6 {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:55:08 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread info: [<_MainThread(MainThread, started 135345251610752)>, , , , , ] {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:07 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:56:07 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:07 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:07 devstack sudo[83489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:56:07 devstack sudo[83489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:07 devstack sudo[83489]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:07 devstack sudo[83497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:56:07 devstack sudo[83497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:07 devstack sudo[83497]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:07 devstack sudo[83500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:56:07 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:08 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:08 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:08 devstack cinder-volume[76769]: DEBUG cinder.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Notifying Schedulers of capabilities ... {{(pid=76769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:56:14 devstack cinder-volume[76769]: DEBUG dbcounter [-] [76769] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:07 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:57:07 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:07 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:07 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:57:07 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:07 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:07 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:57:07 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:07 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:07 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:57:07 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:08 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:08 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:08 devstack cinder-volume[76769]: DEBUG cinder.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Notifying Schedulers of capabilities ... {{(pid=76769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:57:08 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager._thread_info {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:57:08 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread count: 6 {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:57:08 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread info: [<_MainThread(MainThread, started 135345251610752)>, , , , , ] {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG cinder.volume.drivers.lvm [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Updating volume stats {{(pid=76769) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:07 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:58:07 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:07 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:07 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:58:07 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:07 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:07 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:58:07 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:07 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:07 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:07 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:58:07 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:08 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:08 devstack cinder-volume[76769]: DEBUG oslo_concurrency.processutils [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:08 devstack cinder-volume[76769]: DEBUG cinder.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Notifying Schedulers of capabilities ... {{(pid=76769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:58:08 devstack cinder-volume[76769]: DEBUG oslo_service.periodic_task [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] Running periodic task VolumeManager._thread_info {{(pid=76769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:58:08 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread count: 6 {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:58:08 devstack cinder-volume[76769]: DEBUG cinder.volume.manager [None req-4d2a1cdf-1514-4567-b33a-84c462c916cc None None] thread info: [<_MainThread(MainThread, started 135345251610752)>, , , , , ] {{(pid=76769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:58:14 devstack cinder-volume[76769]: DEBUG dbcounter [-] [76769] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:16 devstack cinder-volume[76581]: INFO oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Caught SIGTERM, stopping children Sep 11 22:58:16 devstack cinder-volume[76581]: DEBUG oslo_concurrency.lockutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Acquiring lock "singleton_lock" {{(pid=76581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:16 devstack cinder-volume[76581]: DEBUG oslo_concurrency.lockutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Acquired lock "singleton_lock" {{(pid=76581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:16 devstack cinder-volume[76581]: DEBUG oslo_concurrency.lockutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Releasing lock "singleton_lock" {{(pid=76581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:16 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Stop services. {{(pid=76581) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 22:58:16 devstack cinder-volume[76581]: DEBUG oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Killing children. {{(pid=76581) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 22:58:16 devstack cinder-volume[76581]: INFO oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Waiting on 1 children to exit Sep 11 22:58:18 devstack cinder-volume[76769]: DEBUG oslo_concurrency.lockutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Acquiring lock "singleton_lock" {{(pid=76769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:18 devstack cinder-volume[76769]: DEBUG oslo_concurrency.lockutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Acquired lock "singleton_lock" {{(pid=76769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:18 devstack cinder-volume[76769]: DEBUG oslo_concurrency.lockutils [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Releasing lock "singleton_lock" {{(pid=76769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:18 devstack cinder-volume[76769]: WARNING amqp [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:58:18 devstack cinder-volume[76769]: WARNING amqp [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:58:18 devstack cinder-volume[76581]: INFO oslo_service.backend._eventlet.service [None req-f4009652-db7c-4e48-a2a6-35dc13fb1fdd None None] Child 76769 exited with status 0 Sep 11 22:58:18 devstack cinder-volume[87179]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 22:58:18 devstack cinder-volume[87179]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 22:58:18 devstack cinder-volume[87179]: we strongly recommend against using it for new projects. Sep 11 22:58:18 devstack cinder-volume[87179]: If you are already using Eventlet, we recommend migrating to a different Sep 11 22:58:18 devstack cinder-volume[87179]: framework. For more detail see Sep 11 22:58:18 devstack cinder-volume[87179]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 22:58:18 devstack cinder-volume[87179]: import eventlet # noqa Sep 11 22:58:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:21 devstack cinder-volume[87179]: INFO dbcounter [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Registered counter for database cinder Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_db.sqlalchemy.engines [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writer thread running {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:58:21 devstack cinder-volume[87179]: INFO cinder.rpc [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 22:58:21 devstack cinder-volume[87179]: INFO cinder.rpc [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_db.sqlalchemy.engines [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Determined volume DB was empty at startup. Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87179) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 22:58:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 22:58:21 devstack cinder-volume[87179]: WARNING stevedore.named [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:58:21 devstack cinder-volume[87179]: WARNING castellan.key_manager [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:58:21 devstack cinder-volume[87179]: WARNING cinder.keymgr.conf_key_mgr [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:58:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_db.sqlalchemy.engines [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:21 devstack cinder-volume[87179]: INFO oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Starting 1 workers Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Started child 87393 {{(pid=87179) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Full set of CONF: {{(pid=87179) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] ******************************************************************************** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Configuration options gathered from: {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] ================================================================================ {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] allow_availability_zone_fallback = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] allow_compression_on_image_upload = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] allowed_direct_url_schemes = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] api_rate_limit = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87393]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] auth_strategy = keystone {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_availability_zone = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_host = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_stats_polling_interval = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backup_api_class = cinder.backup.api.API {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backup_name_template = backup-%s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backup_use_same_host = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backup_use_temp_snapshot = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] chap_password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] chap_username = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_internal_tenant_project_id = 3454e3af160044719ee0dc73031af0dd {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_internal_tenant_user_id = 0c1999cea07b44a0b36148b96b53be8c {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cluster = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] compression_format = gzip {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] compute_api_class = cinder.compute.nova.API {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] config_dir = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] config_source = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] control_exchange = openstack {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] debug = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] default_availability_zone = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] default_group_type = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] default_volume_type = QuobyteHD {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] disk_geometry = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] driver_client_cert = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] driver_client_cert_key = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] driver_data_namespace = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] driver_ssl_cert_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] driver_ssl_cert_verify = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] driver_use_ssl = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] enable_new_services = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] enable_unsupported_driver = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] enabled_backends = ['QuobyteHD'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] enforce_multipath_for_image_xfer = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] filter_function = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_api_insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_api_ssl_compression = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_ca_certificates_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_catalog_info = image:glance:publicURL {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_num_retries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance_request_timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] goodness_function = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] graceful_shutdown_timeout = 5 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] group_api_class = cinder.group.api.API {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] host = devstack {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_compress_on_upload = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_conversion_address_space_limit = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_conversion_cpu_limit = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_conversion_disable = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_introspection_address_space_limit = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_introspection_cpu_limit = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_upload_use_cinder_backend = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_upload_use_internal_tenant = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_volume_cache_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_volume_cache_max_count = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] image_volume_cache_max_size_gb = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] init_host_max_objects_retrieval = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] instance_format = [instance: %(uuid)s] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] iscsi_target_flags = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] iscsi_write_cache = on {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] iser_helper = tgtadm {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] iser_ip_address = 192.168.122.159 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] iser_port = 3260 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_color = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_config_append = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_dir = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_options = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_rotate_interval = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_rotate_interval_type = days {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] log_rotation_type = none {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] max_age = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] max_logfile_count = 30 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] max_logfile_size_mb = 200 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] max_over_subscription_ratio = 20.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] message_reap_interval = 86400 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] message_ttl = 2592000 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] migration_create_volume_timeout_secs = 300 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] monkey_patch = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] monkey_patch_modules = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] my_ip = 192.168.122.159 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] no_snapshot_gb_quota = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] num_iser_scan_tries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] num_shell_tries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] num_volume_device_scan_tries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] nvmeof_conn_info_version = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] nvmet_ns_id = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] nvmet_port_id = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_max_limit = 1000 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_volume_ext_list = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_volume_listen_port = 8776 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_volume_use_ssl = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] osapi_volume_workers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] per_volume_size_limit = -1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] periodic_fuzzy_delay = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] periodic_interval = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] public_endpoint = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] publish_errors = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_backup_gigabytes = 1000 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_backups = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_gigabytes = 1000 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_groups = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_snapshots = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] quota_volumes = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] rate_limit_burst = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] rate_limit_except_level = CRITICAL {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] rate_limit_interval = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] reinit_driver_count = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] replication_device = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] report_discard_supported = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] report_interval = 120 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] reservation_clean_interval = 86400 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] reservation_expire = 86400 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] reserved_image_namespaces = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] reserved_percentage = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] rpc_response_timeout = 120 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] run_external_periodic_tasks = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] scst_target_driver = iscsi {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] scst_target_iqn_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_down_time = 720 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] shell_completion = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] snapshot_name_template = snapshot-%s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] split_loggers = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] state_path = /opt/stack/data/cinder {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] storage_availability_zone = nova {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] storage_protocol = iSCSI {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] syslog_log_facility = LOG_USER {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] target_helper = lioadm {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] target_ip_address = 192.168.122.159 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] target_port = 3260 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] target_protocol = iscsi {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] target_secondary_ip_addresses = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] trace_flags = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] transport_url = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] until_refresh = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_chap_auth = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_default_quota_class = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_journal = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_json = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_multipath_for_image_xfer = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_stderr = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] use_syslog = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] verify_glance_signatures = enabled {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_api_class = cinder.volume.api.API {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_backend_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_clear = zero {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_clear_ionice = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_clear_size = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_copy_bps_limit = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_dd_blocksize = 1M {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_name_template = volume-%s {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_service_inithost_offload = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volume_usage_audit_period = month {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] zoning_mode = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_concurrency.disable_process_locking = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87393]: INFO cinder.volume.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.auth_section = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.remotefs [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87393) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.auth_type = password {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.auth_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.cache = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.include_service_catalog = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.interface = public {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcache_username = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.region_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.service_type = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.backend = dogpile.cache.null {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.backend_argument = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.backend_expiration_time = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.config_prefix = cache.oslo {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.debug_cache_backend = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.enable_retry_client = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.enable_socket_keepalive = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.expiration_time = 600 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.hashclient_retry_attempts = 2 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_dead_retry = 300 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_pool_maxsize = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_sasl_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.proxies = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.redis_db = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.redis_server = localhost:6379 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.retry_attempts = 2 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.retry_delay = 0.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.socket_keepalive_count = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.socket_keepalive_idle = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.socket_keepalive_interval = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.socket_timeout = 1.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.tls_allowed_ciphers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.tls_cafile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.tls_certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.tls_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.tls_keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cache.username = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] coordination.backend_url = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.asyncio_connection = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.asyncio_slave_connection = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.backend = sqlalchemy {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.connection = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.connection_debug = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.connection_parameters = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.connection_recycle_time = 3600 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.connection_trace = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.db_inc_retry_interval = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.db_max_retries = 20 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.db_max_retry_interval = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.db_retry_interval = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.max_overflow = 50 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.max_pool_size = 5 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.max_retries = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.mysql_wsrep_sync_wait = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.pool_timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.retry_interval = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.slave_connection = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.sqlite_synchronous = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.synchronous_reader = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] database.use_db_reconnect = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_tracing.insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.connection_string = messaging:// {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.es_doc_type = notification {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.es_scroll_size = 10000 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.es_scroll_time = 2m {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.filter_error_trace = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.hmac_keys = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.sentinel_service_name = mymaster {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.socket_timeout = 0.1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.trace_requests = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler.trace_sqlalchemy = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler_jaeger.process_tags = {} {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler_jaeger.service_name_prefix = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] profiler_otlp.service_name_prefix = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.enforce_new_defaults = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.policy_default_rule = default {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.policy_file = policy.yaml {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.group = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.helper_command = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] privsep_osbrick.user = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.group = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.helper_command = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] cinder_sys_admin.user = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.auth_section = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.auth_type = password {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.cafile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.collect_timing = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.send_service_user_token = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.split_loggers = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.tls_ciphers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] service_user.tls_min_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.auth_section = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.auth_type = password {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.collect_timing = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.region_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.split_loggers = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.tls_ciphers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] glance.tls_min_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.backend_availability_zone = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.chap_password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.chap_username = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.disk_geometry = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.driver_client_cert = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.driver_client_cert_key = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.driver_data_namespace = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.driver_use_ssl = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.extra_capabilities = {} {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.filter_function = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.goodness_function = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.iscsi_target_flags = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.iscsi_write_cache = on {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.iser_helper = tgtadm {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.iser_port = 3260 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_host = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_login = admin {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_mount_options = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_private_key = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_share_path = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.num_shell_tries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:21 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87393) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 22:58:22 devstack cinder-volume[87393]: WARNING cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 22:58:22 devstack cinder-volume[87393]: WARNING cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.quobyte_volume_url = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Running cmd (subprocess): mount.quobyte {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.replication_device = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.report_discard_supported = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.reserved_percentage = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.target_helper = tgtadm {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.target_port = 3260 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.target_protocol = iscsi {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.trace_flags = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.unique_fqdn_network = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.use_chap_auth = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_backend_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_clear = zero {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_clear_ionice = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_clear_size = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_reports.file_event_handler = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_reports.log_dir = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.backend_availability_zone = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.backend_host = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.chap_password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.chap_username = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.chiscsi_conf = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.disk_geometry = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.driver_client_cert = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.driver_data_namespace = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.driver_use_ssl = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.extra_capabilities = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.filter_function = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.goodness_function = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.iser_helper = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.iser_ip_address = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.iser_port = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.iser_target_prefix = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_host = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_login = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_mount_options = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_password = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_private_key = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_share_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_ssh_port = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.num_shell_tries = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.nvmet_port_id = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.replication_device = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.report_discard_supported = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.reserved_percentage = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.scst_target_driver = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.storage_protocol = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.target_helper = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.target_ip_address = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.target_port = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.target_prefix = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.target_protocol = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.trace_flags = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.use_chap_auth = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_clear = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_clear_size = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] QuobyteHD.volumes_dir = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_notifications.driver = [] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_notifications.retry = -1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] key_manager.fixed_key = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.barbican_api_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.barbican_endpoint = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.barbican_endpoint_type = public {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.barbican_region_name = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.cafile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.collect_timing = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.number_of_retries = 60 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.retry_delay = 1 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.send_service_user_token = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.split_loggers = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.tls_ciphers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.tls_min_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.verify_ssl = True {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican.verify_ssl_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.auth_section = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.auth_type = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.cafile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.certfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.collect_timing = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.insecure = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.keyfile = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.split_loggers = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.timeout = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.tls_ciphers = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] barbican_service_user.tls_min_version = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.approle_role_id = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.approle_secret_id = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.auth_method = approle {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.auth_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.kv_mountpoint = secret {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.kv_path = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.kv_version = 2 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.namespace = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.root_token_id = **** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.ssl_ca_crt_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.timeout = 60.0 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=87393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.token_file = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.token_role = None {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.use_ssl = False {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87393]: INFO cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd ... Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:22 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] ******************************************************************************** {{(pid=87179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca -c /etc/quobyte/client-cinder.cfg {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:22 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca -c /etc/quobyte/client-cinder.cfg Sep 11 22:58:22 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:22 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.419s {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:22 devstack cinder-volume[87393]: INFO cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd succeeded Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=87393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.438s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:22 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:22 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:22 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.245s {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:22 devstack cinder-volume[87393]: INFO cinder.volume.driver [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Driver hasn't implemented _init_vendor_properties() Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.volume.driver [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87393) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_db.sqlalchemy.engines [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG dbcounter [-] [87393] Writer thread running {{(pid=87393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.db.api [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Building query based on filter {{(pid=87393) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.image.image_utils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87393) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 22:58:22 devstack cinder-volume[87393]: INFO cinder.keymgr.migration [None req-e03ff3e9-5145-44fb-a177-250be89a52ee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=87393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=87393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:22 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:22 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:22 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:23 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.233s {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG cinder.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Notifying Schedulers of capabilities ... {{(pid=87393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:58:23 devstack cinder-volume[87393]: INFO cinder.volume.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Driver initialization completed successfully. Sep 11 22:58:23 devstack cinder-volume[87393]: INFO cinder.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Initiating service 3 cleanup Sep 11 22:58:23 devstack cinder-volume[87393]: INFO cinder.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Service 3 cleanup completed. Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG cinder.service [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Creating RPC server for service cinder-volume {{(pid=87393) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG cinder.service [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87393) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 22:58:23 devstack cinder-volume[87393]: INFO cinder.volume.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=87393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=87393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:23 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:23 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:23 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:23 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.237s {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:23 devstack cinder-volume[87393]: INFO cinder.volume.manager [None req-5d1df950-07ec-46df-9bed-5edd917f214e None None] Driver post RPC initialization completed successfully. Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=87393) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG cinder.volume.drivers.quobyte [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=87393) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87393) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:28 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:28 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:28 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG oslo_concurrency.processutils [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.219s {{(pid=87393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:28 devstack cinder-volume[87393]: DEBUG cinder.manager [None req-5330fd06-9a8b-4d09-aa38-279518f7a2a3 None None] Notifying Schedulers of capabilities ... {{(pid=87393) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:58:31 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:31 devstack cinder-volume[87179]: INFO oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Caught SIGTERM, stopping children Sep 11 22:58:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Acquiring lock "singleton_lock" {{(pid=87179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Acquired lock "singleton_lock" {{(pid=87179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Releasing lock "singleton_lock" {{(pid=87179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:31 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Stop services. {{(pid=87179) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 22:58:31 devstack cinder-volume[87179]: DEBUG oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Killing children. {{(pid=87179) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 22:58:31 devstack cinder-volume[87179]: INFO oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Waiting on 1 children to exit Sep 11 22:58:33 devstack cinder-volume[87393]: DEBUG dbcounter [-] [87393] Writing DB stats cinder:SELECT=3 {{(pid=87393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:33 devstack cinder-volume[87393]: DEBUG dbcounter [-] [87393] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:36 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Acquiring lock "singleton_lock" {{(pid=87393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:36 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Acquired lock "singleton_lock" {{(pid=87393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:36 devstack cinder-volume[87393]: DEBUG oslo_concurrency.lockutils [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Releasing lock "singleton_lock" {{(pid=87393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:36 devstack cinder-volume[87393]: WARNING amqp [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:58:36 devstack cinder-volume[87393]: WARNING amqp [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:58:36 devstack cinder-volume[87179]: INFO oslo_service.backend._eventlet.service [None req-78917d73-dd59-4040-8be9-b958a3f9c258 None None] Child 87393 exited with status 0 Sep 11 22:58:37 devstack cinder-volume[87711]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 22:58:37 devstack cinder-volume[87711]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 22:58:37 devstack cinder-volume[87711]: we strongly recommend against using it for new projects. Sep 11 22:58:37 devstack cinder-volume[87711]: If you are already using Eventlet, we recommend migrating to a different Sep 11 22:58:37 devstack cinder-volume[87711]: framework. For more detail see Sep 11 22:58:37 devstack cinder-volume[87711]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 22:58:37 devstack cinder-volume[87711]: import eventlet # noqa Sep 11 22:58:39 devstack cinder-volume[87711]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87711) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:39 devstack cinder-volume[87711]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87711) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:39 devstack cinder-volume[87711]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87711) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:40 devstack cinder-volume[87711]: INFO dbcounter [None req-65132586-3315-407e-883f-91fa173366e9 None None] Registered counter for database cinder Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_db.sqlalchemy.engines [None req-65132586-3315-407e-883f-91fa173366e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87711) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG dbcounter [-] [87711] Writer thread running {{(pid=87711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:58:40 devstack cinder-volume[87711]: INFO cinder.rpc [None req-65132586-3315-407e-883f-91fa173366e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 22:58:40 devstack cinder-volume[87711]: INFO cinder.rpc [None req-65132586-3315-407e-883f-91fa173366e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_db.sqlalchemy.engines [None req-65132586-3315-407e-883f-91fa173366e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87711) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:40 devstack cinder-volume[87711]: INFO cinder.volume.manager [None req-65132586-3315-407e-883f-91fa173366e9 None None] Determined volume DB was empty at startup. Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG cinder.volume.manager [None req-65132586-3315-407e-883f-91fa173366e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87711) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 22:58:40 devstack cinder-volume[87711]: WARNING stevedore.named [None req-65132586-3315-407e-883f-91fa173366e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:58:40 devstack cinder-volume[87711]: WARNING castellan.key_manager [None req-65132586-3315-407e-883f-91fa173366e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:58:40 devstack cinder-volume[87711]: WARNING cinder.keymgr.conf_key_mgr [None req-65132586-3315-407e-883f-91fa173366e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:58:40 devstack cinder-volume[87711]: INFO cinder.volume.manager [None req-65132586-3315-407e-883f-91fa173366e9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_db.sqlalchemy.engines [None req-65132586-3315-407e-883f-91fa173366e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87711) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:40 devstack cinder-volume[87711]: INFO oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] Starting 1 workers Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] Started child 88002 {{(pid=87711) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] Full set of CONF: {{(pid=87711) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] ******************************************************************************** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] Configuration options gathered from: {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] ================================================================================ {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] allow_availability_zone_fallback = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] allow_compression_on_image_upload = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] allowed_direct_url_schemes = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] api_rate_limit = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] auth_strategy = keystone {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_availability_zone = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_host = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_stats_polling_interval = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backup_api_class = cinder.backup.api.API {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backup_name_template = backup-%s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backup_use_same_host = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backup_use_temp_snapshot = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] chap_password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] chap_username = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[88002]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_internal_tenant_project_id = 3454e3af160044719ee0dc73031af0dd {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_internal_tenant_user_id = 0c1999cea07b44a0b36148b96b53be8c {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cluster = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] compression_format = gzip {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] compute_api_class = cinder.compute.nova.API {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] config_dir = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] config_source = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] control_exchange = openstack {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] debug = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] default_availability_zone = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] default_group_type = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] default_volume_type = QuobyteHD {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] disk_geometry = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] driver_client_cert = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] driver_client_cert_key = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] driver_data_namespace = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] driver_ssl_cert_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] driver_ssl_cert_verify = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] driver_use_ssl = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] enable_new_services = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] enable_unsupported_driver = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] enabled_backends = ['QuobyteHD'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] enforce_multipath_for_image_xfer = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] filter_function = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_api_insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_api_ssl_compression = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_ca_certificates_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_catalog_info = image:glance:publicURL {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_num_retries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance_request_timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] goodness_function = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] graceful_shutdown_timeout = 5 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] group_api_class = cinder.group.api.API {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] host = devstack {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_compress_on_upload = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_conversion_address_space_limit = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_conversion_cpu_limit = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_conversion_disable = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_introspection_address_space_limit = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_introspection_cpu_limit = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_upload_use_cinder_backend = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_upload_use_internal_tenant = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_volume_cache_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_volume_cache_max_count = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] init_host_max_objects_retrieval = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] instance_format = [instance: %(uuid)s] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] iscsi_target_flags = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] iscsi_write_cache = on {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] iser_helper = tgtadm {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] iser_ip_address = 192.168.122.159 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] iser_port = 3260 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_color = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_config_append = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_dir = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_options = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_rotate_interval = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_rotate_interval_type = days {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] log_rotation_type = none {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] max_age = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] max_logfile_count = 30 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] max_logfile_size_mb = 200 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] max_over_subscription_ratio = 20.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] message_reap_interval = 86400 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] message_ttl = 2592000 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] monkey_patch = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] monkey_patch_modules = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] my_ip = 192.168.122.159 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] no_snapshot_gb_quota = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] num_iser_scan_tries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] num_shell_tries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] num_volume_device_scan_tries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] nvmeof_conn_info_version = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] nvmet_ns_id = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] nvmet_port_id = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_max_limit = 1000 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_volume_ext_list = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_volume_listen_port = 8776 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_volume_use_ssl = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] osapi_volume_workers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] per_volume_size_limit = -1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] periodic_fuzzy_delay = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] periodic_interval = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] public_endpoint = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] publish_errors = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_backup_gigabytes = 1000 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_backups = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_gigabytes = 1000 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_groups = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_snapshots = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] quota_volumes = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] rate_limit_burst = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] rate_limit_except_level = CRITICAL {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] rate_limit_interval = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] reinit_driver_count = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] replication_device = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] report_discard_supported = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] report_interval = 120 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] reservation_clean_interval = 86400 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] reservation_expire = 86400 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] reserved_image_namespaces = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] reserved_percentage = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] rpc_response_timeout = 120 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] run_external_periodic_tasks = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] scst_target_driver = iscsi {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] scst_target_iqn_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_down_time = 720 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] shell_completion = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88002) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] snapshot_name_template = snapshot-%s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] split_loggers = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] state_path = /opt/stack/data/cinder {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] storage_availability_zone = nova {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] storage_protocol = iSCSI {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] syslog_log_facility = LOG_USER {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] target_helper = lioadm {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] target_ip_address = 192.168.122.159 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] target_port = 3260 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] target_protocol = iscsi {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] target_secondary_ip_addresses = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] trace_flags = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] transport_url = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] until_refresh = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_chap_auth = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_default_quota_class = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_journal = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_json = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_multipath_for_image_xfer = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_stderr = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] use_syslog = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] verify_glance_signatures = enabled {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_api_class = cinder.volume.api.API {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_backend_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_clear = zero {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_clear_ionice = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_clear_size = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_copy_bps_limit = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_dd_blocksize = 1M {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_name_template = volume-%s {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_service_inithost_offload = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volume_usage_audit_period = month {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] zoning_mode = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.auth_section = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.auth_type = password {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.auth_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.cache = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.interface = public {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcache_username = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.region_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.service_type = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.backend = dogpile.cache.null {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.backend_argument = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.backend_expiration_time = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.config_prefix = cache.oslo {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.debug_cache_backend = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.enable_retry_client = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.enable_socket_keepalive = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.expiration_time = 600 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_dead_retry = 300 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_pool_maxsize = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_sasl_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.proxies = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.redis_db = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.redis_server = localhost:6379 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.retry_attempts = 2 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.retry_delay = 0.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.socket_keepalive_count = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.socket_keepalive_idle = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.socket_keepalive_interval = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.socket_timeout = 1.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.tls_allowed_ciphers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.tls_cafile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.tls_certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.tls_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.tls_keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cache.username = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] coordination.backend_url = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.asyncio_connection = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.asyncio_slave_connection = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.backend = sqlalchemy {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.connection = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.connection_debug = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.connection_parameters = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.connection_recycle_time = 3600 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.connection_trace = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.db_inc_retry_interval = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.db_max_retries = 20 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.db_max_retry_interval = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.db_retry_interval = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.max_overflow = 50 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.max_pool_size = 5 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.max_retries = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.pool_timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.retry_interval = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.slave_connection = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.sqlite_synchronous = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.synchronous_reader = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] database.use_db_reconnect = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_tracing.insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.connection_string = messaging:// {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.es_doc_type = notification {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.es_scroll_size = 10000 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.es_scroll_time = 2m {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.filter_error_trace = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.hmac_keys = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.sentinel_service_name = mymaster {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.socket_timeout = 0.1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.trace_requests = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler.trace_sqlalchemy = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler_jaeger.process_tags = {} {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] profiler_otlp.service_name_prefix = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.policy_default_rule = default {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.policy_file = policy.yaml {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.group = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.helper_command = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] privsep_osbrick.user = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.group = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.helper_command = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] cinder_sys_admin.user = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.auth_section = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.auth_type = password {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.cafile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.collect_timing = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.send_service_user_token = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.split_loggers = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.tls_ciphers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] service_user.tls_min_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.auth_section = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.auth_type = password {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.collect_timing = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.region_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.split_loggers = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.tls_ciphers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] glance.tls_min_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.backend_availability_zone = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.chap_password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.chap_username = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.disk_geometry = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.driver_client_cert = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.driver_data_namespace = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.driver_use_ssl = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.extra_capabilities = {} {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.filter_function = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.goodness_function = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.iscsi_target_flags = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.iser_helper = tgtadm {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.iser_port = 3260 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_host = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_login = admin {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_mount_options = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_private_key = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_share_path = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.quobyte_volume_url = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.replication_device = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.report_discard_supported = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:40 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.target_helper = tgtadm {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.target_port = 3260 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.target_protocol = iscsi {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.trace_flags = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.use_chap_auth = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_backend_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_clear = zero {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88002) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 22:58:41 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 22:58:41 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_reports.file_event_handler = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_reports.log_dir = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.backend_availability_zone = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.backend_host = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.chap_password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Running cmd (subprocess): mount.quobyte {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.chap_username = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.chiscsi_conf = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.disk_geometry = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.driver_client_cert = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.driver_data_namespace = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.driver_use_ssl = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.extra_capabilities = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.filter_function = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.goodness_function = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.iser_helper = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.iser_ip_address = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.iser_port = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.iser_target_prefix = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_host = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_login = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_mount_options = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_password = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_private_key = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_share_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_ssh_port = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.num_shell_tries = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.nvmet_port_id = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.replication_device = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.report_discard_supported = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.reserved_percentage = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.scst_target_driver = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.storage_protocol = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.target_helper = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.target_ip_address = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.target_port = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.target_prefix = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.target_protocol = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.trace_flags = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.use_chap_auth = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_clear = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_clear_size = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] QuobyteHD.volumes_dir = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack quobyte-client[88012]: Reading configuration file: /etc/quobyte/client.cfg Sep 11 22:58:41 devstack quobyte-client[88012]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] CMD "mount.quobyte" returned: 1 in 0.046s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_notifications.driver = [] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] key_manager.fixed_key = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.barbican_api_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.barbican_endpoint = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.barbican_endpoint_type = public {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.barbican_region_name = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.cafile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.collect_timing = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.number_of_retries = 60 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.retry_delay = 1 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.send_service_user_token = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.split_loggers = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.tls_ciphers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.tls_min_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.verify_ssl = True {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican.verify_ssl_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.auth_section = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.auth_type = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.cafile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.certfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.collect_timing = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.insecure = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.keyfile = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.split_loggers = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.timeout = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.tls_ciphers = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] barbican_service_user.tls_min_version = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.approle_role_id = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.approle_secret_id = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.auth_method = approle {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.auth_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.kv_mountpoint = secret {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.kv_path = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.kv_version = 2 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.namespace = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.root_token_id = **** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.ssl_ca_crt_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.timeout = 60.0 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.token_file = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.token_role = None {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.use_ssl = False {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:58:41 devstack cinder-volume[87711]: DEBUG oslo_service.backend._eventlet.service [None req-65132586-3315-407e-883f-91fa173366e9 None None] ******************************************************************************** {{(pid=87711) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 22:58:41 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:41 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:41 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.226s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:41 devstack cinder-volume[88002]: INFO cinder.volume.driver [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.driver [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88002) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_db.sqlalchemy.engines [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88002) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writer thread running {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.db.api [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Building query based on filter {{(pid=88002) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88002) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:41 devstack cinder-volume[88002]: INFO cinder.keymgr.migration [None req-a4061609-f7cf-41e8-802a-b485bc134a8b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 22:58:41 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:41 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:41 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.227s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:58:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Driver initialization completed successfully. Sep 11 22:58:41 devstack cinder-volume[88002]: INFO cinder.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Initiating service 3 cleanup Sep 11 22:58:41 devstack cinder-volume[88002]: INFO cinder.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Service 3 cleanup completed. Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.service [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Creating RPC server for service cinder-volume {{(pid=88002) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.service [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88002) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 22:58:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:58:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:41 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:58:41 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:42 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:42 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-42bab5b8-e82a-45a7-8e0b-426793aad7a2 None None] Driver post RPC initialization completed successfully. Sep 11 22:58:50 devstack cinder-volume[87711]: DEBUG dbcounter [-] [87711] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:51 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=3 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:52 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:58:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 6 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:58:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Flow 'volume_create_manager' (6b52847b-3b94-421f-84bc-aa9f0895ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4407007-1c97-4c2c-a563-8d69b40a6881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4407007-1c97-4c2c-a563-8d69b40a6881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T20:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1473349688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a797e4d-6211-4f04-9a8e-e39352a4d7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8364c7878342c282023c1812ee056a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T20:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T20:59:40Z,use_quota=True,user_id='eefe0b9d2fa1496eaca75ae25d2295f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e27615-780d-4c9b-95fa-774893b05725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e27615-780d-4c9b-95fa-774893b05725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f887fcc-00b0-4ec9-a744-3a3463f72486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f887fcc-00b0-4ec9-a744-3a3463f72486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a797e4d-6211-4f04-9a8e-e39352a4d7fc', 'volume_name': 'volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b01f42e-9ddf-4992-b3d6-8aafb2c5e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b01f42e-9ddf-4992-b3d6-8aafb2c5e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d06479-9434-4a20-b744-89d3c7283aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Volume 7a797e4d-6211-4f04-9a8e-e39352a4d7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc', 'volume_size': 1} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T20:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1473349688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a797e4d-6211-4f04-9a8e-e39352a4d7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8364c7878342c282023c1812ee056a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T20:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T20:59:40Z,use_quota=True,user_id='eefe0b9d2fa1496eaca75ae25d2295f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Creating volume 7a797e4d-6211-4f04-9a8e-e39352a4d7fc {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 22:59:39 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 22:59:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:39 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc 1073741824 Sep 11 22:59:39 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:40 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc 1073741824" returned: 0 in 0.680s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:40 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc Sep 11 22:59:40 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:41 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc" returned: 0 in 0.353s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d06479-9434-4a20-b744-89d3c7283aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a62fe9-7727-4c44-a67f-3ca02989f25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:41 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Volume volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc (7a797e4d-6211-4f04-9a8e-e39352a4d7fc): created successfully Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a62fe9-7727-4c44-a67f-3ca02989f25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Flow 'volume_create_manager' (6b52847b-3b94-421f-84bc-aa9f0895ea75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 22:59:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dc1d30d3-e0ec-4c1e-a488-3128550abccf tempest-TaggedAttachmentsTest-529970911 None] Created volume successfully. Sep 11 22:59:51 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:59:51 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Flow 'volume_create_manager' (b0de6637-fc79-4f20-bfc8-d737eb0cea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9767215-a651-479c-839d-822a776240a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9767215-a651-479c-839d-822a776240a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T20:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1247581614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b87cb59-8d3b-4f28-abf4-6135759ee11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ef0dcfcf20478cbdddf7b3fd8ffb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T20:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T20:59:55Z,use_quota=True,user_id='8716015edf314fa4b47a8e2a9fe2c4de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81bd388-0ee5-41f0-a3bc-c1f93eac124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81bd388-0ee5-41f0-a3bc-c1f93eac124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575b384e-8101-46f4-830c-12a6e230b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575b384e-8101-46f4-830c-12a6e230b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b87cb59-8d3b-4f28-abf4-6135759ee11a', 'volume_name': 'volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83441100-1436-4f29-8c53-8069782db199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83441100-1436-4f29-8c53-8069782db199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb1afbc-70d0-4025-b492-dd48fe69d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Volume 0b87cb59-8d3b-4f28-abf4-6135759ee11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a', 'volume_size': 1} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T20:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1247581614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b87cb59-8d3b-4f28-abf4-6135759ee11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ef0dcfcf20478cbdddf7b3fd8ffb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T20:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T20:59:55Z,use_quota=True,user_id='8716015edf314fa4b47a8e2a9fe2c4de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Creating volume 0b87cb59-8d3b-4f28-abf4-6135759ee11a {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 22:59:55 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 22:59:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:55 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a 1073741824 Sep 11 22:59:55 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:56 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a 1073741824" returned: 0 in 1.232s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:57 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a Sep 11 22:59:57 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:57 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a" returned: 0 in 0.895s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 22:59:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb1afbc-70d0-4025-b492-dd48fe69d03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc444d5-a48d-4a3f-bae3-ecaee94d73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 22:59:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Volume volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a (0b87cb59-8d3b-4f28-abf4-6135759ee11a): created successfully Sep 11 22:59:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc444d5-a48d-4a3f-bae3-ecaee94d73ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 22:59:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Flow 'volume_create_manager' (b0de6637-fc79-4f20-bfc8-d737eb0cea11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 22:59:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fe71160f-65bd-41c7-9afa-bffcb265986f tempest-DeleteServersTestJSON-1343207942 None] Created volume successfully. Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:59 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 22:59:59 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:59 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.481s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 6 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:59:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:00:04 devstack cinder-volume[88002]: WARNING py.warnings [req-7e2092a2-716a-4b3f-b64c-93ab3a670a6f req-d96e4698-64c2-42ce-984f-47c443f2da94 tempest-DeleteServersTestJSON-1343207942 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 11 23:00:04 devstack cinder-volume[88002]: .first() Sep 11 23:00:04 devstack cinder-volume[88002]: Sep 11 23:00:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7e2092a2-716a-4b3f-b64c-93ab3a670a6f req-d96e4698-64c2-42ce-984f-47c443f2da94 tempest-DeleteServersTestJSON-1343207942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7e2092a2-716a-4b3f-b64c-93ab3a670a6f req-d96e4698-64c2-42ce-984f-47c443f2da94 tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7e2092a2-716a-4b3f-b64c-93ab3a670a6f req-d96e4698-64c2-42ce-984f-47c443f2da94 tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7e2092a2-716a-4b3f-b64c-93ab3a670a6f req-d96e4698-64c2-42ce-984f-47c443f2da94 tempest-DeleteServersTestJSON-1343207942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3db99094-29b1-4887-8dd4-ed014ba22d82', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:00:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-7e2092a2-716a-4b3f-b64c-93ab3a670a6f req-d96e4698-64c2-42ce-984f-47c443f2da94 tempest-DeleteServersTestJSON-1343207942 None] attachment_update completed successfully. Sep 11 23:00:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-395cc8c0-bfa7-4a40-b238-561b9aedb850 req-828a00f1-cf49-4be1-af71-0c12857ae62b tempest-DeleteServersTestJSON-1343207942 None] Terminate volume connection completed successfully. Sep 11 23:00:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-395cc8c0-bfa7-4a40-b238-561b9aedb850 req-828a00f1-cf49-4be1-af71-0c12857ae62b tempest-DeleteServersTestJSON-1343207942 None] Deleting attachment 3db99094-29b1-4887-8dd4-ed014ba22d82. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Flow 'volume_create_manager' (39f127dd-5b78-4ba9-810e-decf13d210ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215ae2ce-d341-4333-a154-2010cb09ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Acquiring lock "cinder-0b87cb59-8d3b-4f28-abf4-6135759ee11a-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215ae2ce-d341-4333-a154-2010cb09ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-134057689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0de0035-7c7b-4472-86c2-7fd02553ee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d163421f11490db4145475d19c833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:14Z,use_quota=True,user_id='1e3829d07add4dfa8497ea0f6f06342d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5565df96-8fe6-4be1-864c-c60bf5c7f210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5565df96-8fe6-4be1-864c-c60bf5c7f210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811182e3-905c-425d-baa6-9fd969d9a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811182e3-905c-425d-baa6-9fd969d9a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0de0035-7c7b-4472-86c2-7fd02553ee06', 'volume_name': 'volume-f0de0035-7c7b-4472-86c2-7fd02553ee06', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c655d6f-9c2b-4a66-9758-f38fb81e2f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c655d6f-9c2b-4a66-9758-f38fb81e2f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82695590-9821-4ed1-94e4-27ab5ec8d13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Volume f0de0035-7c7b-4472-86c2-7fd02553ee06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0de0035-7c7b-4472-86c2-7fd02553ee06', 'volume_size': 1} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-134057689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0de0035-7c7b-4472-86c2-7fd02553ee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d163421f11490db4145475d19c833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:14Z,use_quota=True,user_id='1e3829d07add4dfa8497ea0f6f06342d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Creating volume f0de0035-7c7b-4472-86c2-7fd02553ee06 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:00:13 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Lock "cinder-0b87cb59-8d3b-4f28-abf4-6135759ee11a-delete_volume" acquired by "delete_volume" :: waited 0.174s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:13 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 1073741824 Sep 11 23:00:13 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Acquiring lock "cinder-quobyte-0b87cb59-8d3b-4f28-abf4-6135759ee11a" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Lock "cinder-quobyte-0b87cb59-8d3b-4f28-abf4-6135759ee11a" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:13 devstack cinder-volume[88002]: INFO oslo.privsep.daemon [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgdaf32bi/privsep.sock'] Sep 11 23:00:14 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgdaf32bi/privsep.sock Sep 11 23:00:14 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:14 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 1073741824" returned: 0 in 0.915s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:14 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 Sep 11 23:00:14 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:15 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06" returned: 0 in 0.438s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82695590-9821-4ed1-94e4-27ab5ec8d13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0de0035-7c7b-4472-86c2-7fd02553ee06', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af19b0d7-3cae-450a-9657-f8285db8f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Volume volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 (f0de0035-7c7b-4472-86c2-7fd02553ee06): created successfully Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af19b0d7-3cae-450a-9657-f8285db8f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Flow 'volume_create_manager' (39f127dd-5b78-4ba9-810e-decf13d210ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-23029e52-191d-4fe4-8311-adc15c5dcba9 tempest-VolumesAdminNegativeTest-2125214835 None] Created volume successfully. Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 23:00:15 devstack cinder-volume[88002]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 11 23:00:16 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:16 devstack cinder-volume[88002]: INFO oslo.privsep.daemon [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Spawned new privsep daemon via rootwrap Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Accepted privsep connection to /tmp/tmpgdaf32bi/privsep.sock {{(pid=88002) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 11 23:00:16 devstack cinder-volume[88002]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 11 23:00:16 devstack cinder-volume[88002]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 11 23:00:16 devstack cinder-volume[88002]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 11 23:00:16 devstack cinder-volume[88002]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89656 Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b513996-dff8-49ec-9485-4523a38ef187]: (2,) {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3ad34-91eb-496a-8943-2c0e24952c22]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:16 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a Sep 11 23:00:16 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Acquiring lock "cinder-f0de0035-7c7b-4472-86c2-7fd02553ee06-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Lock "cinder-f0de0035-7c7b-4472-86c2-7fd02553ee06-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:16 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a" returned: 0 in 0.765s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Acquiring lock "cinder-quobyte-f0de0035-7c7b-4472-86c2-7fd02553ee06" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:16 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a Sep 11 23:00:16 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Lock "cinder-quobyte-f0de0035-7c7b-4472-86c2-7fd02553ee06" acquired by "delete_volume" :: waited 0.057s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e868a2-3781-4c43-9416-2ec507a5a63d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:17 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 Sep 11 23:00:17 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:17 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06" returned: 0 in 0.630s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:17 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0b87cb59-8d3b-4f28-abf4-6135759ee11a" returned: 0 in 0.813s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Lock "cinder-quobyte-0b87cb59-8d3b-4f28-abf4-6135759ee11a" released by "delete_volume" :: held 3.775s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:17 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06 Sep 11 23:00:17 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:17 devstack cinder-volume[88002]: WARNING cinder.quota [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:00:17 devstack cinder-volume[88002]: WARNING cinder.quota [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:00:17 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Created reservations ['89b347ac-92bf-4e19-8372-3bf4a230d849', '1d446d52-b788-4bcb-a2ad-811509df00b7', '33481db7-6e8d-4467-8ec6-2030a407405d', '68badb19-ec4c-49f9-8699-6161f4b5b958'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:18 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:00:18 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:18 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f0de0035-7c7b-4472-86c2-7fd02553ee06" returned: 0 in 0.538s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Lock "cinder-quobyte-f0de0035-7c7b-4472-86c2-7fd02553ee06" released by "delete_volume" :: held 1.255s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Created reservations ['8414f637-8dc8-4b1e-9e09-b51954e7b5f4', 'b946939a-b620-4c52-a2c0-2cb8c137b676', '2b70ba41-63fa-46dd-bcb0-838bc807acd8', '4a9457c1-a311-458b-92e5-edbea13c6405'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:00:18 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.325s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:00:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Deleted volume successfully. Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0560b83f-2e31-47e5-a188-f85c0b0d141b tempest-DeleteServersTestJSON-1343207942 None] Lock "cinder-0b87cb59-8d3b-4f28-abf4-6135759ee11a-delete_volume" released by "delete_volume" :: held 4.933s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:18 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:00:18 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:19 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.537s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:19 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:00:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Deleted volume successfully. Sep 11 23:00:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b61ff854-261d-4b36-b2b3-bfcda61b091d tempest-VolumesAdminNegativeTest-2125214835 None] Lock "cinder-f0de0035-7c7b-4472-86c2-7fd02553ee06-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:28 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=23,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:29 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=26,cinder:SELECT=20,cinder:INSERT=4,cinder:DELETE=3 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:52 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:52 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5fd44eea-8234-4d0d-8628-fe6978fd507f req-fb012993-48bb-4d62-b917-84494d8c831a tempest-TaggedAttachmentsTest-529970911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5fd44eea-8234-4d0d-8628-fe6978fd507f req-fb012993-48bb-4d62-b917-84494d8c831a tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5fd44eea-8234-4d0d-8628-fe6978fd507f req-fb012993-48bb-4d62-b917-84494d8c831a tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-5fd44eea-8234-4d0d-8628-fe6978fd507f req-fb012993-48bb-4d62-b917-84494d8c831a tempest-TaggedAttachmentsTest-529970911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dad85e7-ca01-4f1f-921c-0d994f994f4b', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:00:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-5fd44eea-8234-4d0d-8628-fe6978fd507f req-fb012993-48bb-4d62-b917-84494d8c831a tempest-TaggedAttachmentsTest-529970911 None] attachment_update completed successfully. Sep 11 23:00:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-d5845706-9267-423e-8da2-0ffdd274738d req-2bd56e73-3521-4b0c-aa5e-2de3dad5227e tempest-TaggedAttachmentsTest-529970911 None] Terminate volume connection completed successfully. Sep 11 23:00:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-d5845706-9267-423e-8da2-0ffdd274738d req-2bd56e73-3521-4b0c-aa5e-2de3dad5227e tempest-TaggedAttachmentsTest-529970911 None] Deleting attachment 1dad85e7-ca01-4f1f-921c-0d994f994f4b. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:59 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:00:59 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:59 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.411s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 8 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:00:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:01:02 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:07 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Acquiring lock "cinder-7a797e4d-6211-4f04-9a8e-e39352a4d7fc-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Lock "cinder-7a797e4d-6211-4f04-9a8e-e39352a4d7fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Acquiring lock "cinder-quobyte-7a797e4d-6211-4f04-9a8e-e39352a4d7fc" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Lock "cinder-quobyte-7a797e4d-6211-4f04-9a8e-e39352a4d7fc" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9583c406-a6b9-4d4b-8574-035edab0f712]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:17 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc Sep 11 23:01:17 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:17 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:17 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc Sep 11 23:01:17 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:18 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7a797e4d-6211-4f04-9a8e-e39352a4d7fc" returned: 0 in 0.257s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Lock "cinder-quobyte-7a797e4d-6211-4f04-9a8e-e39352a4d7fc" released by "delete_volume" :: held 0.667s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Created reservations ['4e6245c2-15c4-4f9f-8930-c8d3d44e99dc', '557dc1d3-d67d-4a35-ac22-f6004bc5c1d0', 'e7d81261-400f-4adb-9b59-eed60d4f97ce', 'd347d034-2d87-4fd0-aa6c-8583464ad581'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:18 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:01:18 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:18 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Deleted volume successfully. Sep 11 23:01:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec324fbc-c8ce-4be9-be2e-d8378e3d4127 tempest-TaggedAttachmentsTest-529970911 None] Lock "cinder-7a797e4d-6211-4f04-9a8e-e39352a4d7fc-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Flow 'volume_create_manager' (ed8bb8d8-c68e-4d9a-8c36-b76b7c6cb496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880b773c-f57c-421e-aa19-3a6fab8b36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880b773c-f57c-421e-aa19-3a6fab8b36b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-640427529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb0f923-fef1-4cea-915e-1610663cd2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b198f48fc54935b2d95e19de8178c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:28Z,use_quota=True,user_id='4dfd40d388094b95a88b36973d4961ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced1f6f-a6c3-412a-9c7b-23a2880c7b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced1f6f-a6c3-412a-9c7b-23a2880c7b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abd2958-725d-4fd8-9a95-c70caadfbf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abd2958-725d-4fd8-9a95-c70caadfbf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb0f923-fef1-4cea-915e-1610663cd2b9', 'volume_name': 'volume-8bb0f923-fef1-4cea-915e-1610663cd2b9', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a70e47-0a9f-4c0b-b7ec-75344f1a7c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a70e47-0a9f-4c0b-b7ec-75344f1a7c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97874fb-61d4-4bd5-b95a-db2cb0ee2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:28 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Volume 8bb0f923-fef1-4cea-915e-1610663cd2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb0f923-fef1-4cea-915e-1610663cd2b9', 'volume_size': 1} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-640427529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb0f923-fef1-4cea-915e-1610663cd2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b198f48fc54935b2d95e19de8178c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:28Z,use_quota=True,user_id='4dfd40d388094b95a88b36973d4961ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Creating volume 8bb0f923-fef1-4cea-915e-1610663cd2b9 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:28 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:01:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:28 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 1073741824 Sep 11 23:01:28 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Flow 'volume_create_manager' (ba566f4a-fcb0-4e17-80b2-686fba8a661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e247e30-1970-40b4-920f-eff9e3d78dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e247e30-1970-40b4-920f-eff9e3d78dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-25107562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32fc30409c488a8a01782519ff487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:29Z,use_quota=True,user_id='331fc2b6a9c2402990743137be7629fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d63efd-168e-4624-8d09-87c74cc273c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d63efd-168e-4624-8d09-87c74cc273c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266c65b5-3655-43a6-b02d-5a5117217985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266c65b5-3655-43a6-b02d-5a5117217985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b', 'volume_name': 'volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9c7659-33df-4b52-abed-d50e5c567257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9c7659-33df-4b52-abed-d50e5c567257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19228585-4142-488b-a644-4b7a4372bb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:29 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Volume a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b', 'volume_size': 1} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:29 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 1073741824" returned: 0 in 1.088s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:29 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 Sep 11 23:01:29 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:30 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9" returned: 0 in 0.599s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-25107562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32fc30409c488a8a01782519ff487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:29Z,use_quota=True,user_id='331fc2b6a9c2402990743137be7629fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Creating volume a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:30 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97874fb-61d4-4bd5-b95a-db2cb0ee2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb0f923-fef1-4cea-915e-1610663cd2b9', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:30 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b 1073741824 Sep 11 23:01:30 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4510525e-652f-491b-95a1-6253a4429ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Volume volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 (8bb0f923-fef1-4cea-915e-1610663cd2b9): created successfully Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4510525e-652f-491b-95a1-6253a4429ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Flow 'volume_create_manager' (ed8bb8d8-c68e-4d9a-8c36-b76b7c6cb496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-afa99a3d-09a1-4ddd-b14e-6a067185ac08 tempest-ServerActionsTestOtherA-826692292 None] Created volume successfully. Sep 11 23:01:31 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b 1073741824" returned: 0 in 0.675s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:31 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b Sep 11 23:01:31 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:31 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b" returned: 0 in 0.320s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19228585-4142-488b-a644-4b7a4372bb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7886ec2-3e61-40d2-92c9-05e570f912e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Volume volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b (a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b): created successfully Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7886ec2-3e61-40d2-92c9-05e570f912e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Flow 'volume_create_manager' (ba566f4a-fcb0-4e17-80b2-686fba8a661a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d1d4506f-d6a2-4823-b557-193f6363eae5 tempest-AttachVolumeShelveTestJSON-1914941808 None] Created volume successfully. Sep 11 23:01:41 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:41 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Flow 'volume_create_manager' (1d7d189a-e805-4b8d-8f22-a0a29523b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69342c1-93be-451a-847d-fbb2453d94c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69342c1-93be-451a-847d-fbb2453d94c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-816140199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501df27d-fd60-4e21-89b3-778a25844029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4182d43898d34cbcb15855ebbc79f9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:44Z,use_quota=True,user_id='0a46876b7e264104b23fbd6ef0bd563f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fce9cec-72aa-47db-9124-68caa6ef32bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fce9cec-72aa-47db-9124-68caa6ef32bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eeaf47-3b54-4fe4-b58e-c7ed6ca8ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eeaf47-3b54-4fe4-b58e-c7ed6ca8ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501df27d-fd60-4e21-89b3-778a25844029', 'volume_name': 'volume-501df27d-fd60-4e21-89b3-778a25844029', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eba5bc-aedf-4a6c-aa99-e5a90a592961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eba5bc-aedf-4a6c-aa99-e5a90a592961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0d9eb0-06aa-4924-9b41-4ceefb7228b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:44 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Volume 501df27d-fd60-4e21-89b3-778a25844029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501df27d-fd60-4e21-89b3-778a25844029', 'volume_size': 1} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-816140199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501df27d-fd60-4e21-89b3-778a25844029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4182d43898d34cbcb15855ebbc79f9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:44Z,use_quota=True,user_id='0a46876b7e264104b23fbd6ef0bd563f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Creating volume 501df27d-fd60-4e21-89b3-778a25844029 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:44 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:01:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:44 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 1073741824 Sep 11 23:01:44 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:45 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 1073741824" returned: 0 in 0.788s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:45 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 Sep 11 23:01:45 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:45 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029" returned: 0 in 0.538s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0d9eb0-06aa-4924-9b41-4ceefb7228b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501df27d-fd60-4e21-89b3-778a25844029', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ffbae9-ba86-4bc2-9628-11a79b8b9abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:45 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Volume volume-501df27d-fd60-4e21-89b3-778a25844029 (501df27d-fd60-4e21-89b3-778a25844029): created successfully Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ffbae9-ba86-4bc2-9628-11a79b8b9abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Flow 'volume_create_manager' (1d7d189a-e805-4b8d-8f22-a0a29523b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-99c0319d-9524-447c-a0c2-ca94aa4e5fd8 tempest-ServersNegativeTestJSON-1822079312 None] Created volume successfully. Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-c744309e-e1ac-4f66-a10f-d05c52df9c98 req-e35c3fa0-91d1-407a-87b5-f34a2e73f2e9 tempest-AttachVolumeShelveTestJSON-1914941808 None] No connector for attachment 5b72623b-4298-4d58-a79a-a28998b715fb; skipping storage backend terminate_connection call. {{(pid=88002) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-c744309e-e1ac-4f66-a10f-d05c52df9c98 req-e35c3fa0-91d1-407a-87b5-f34a2e73f2e9 tempest-AttachVolumeShelveTestJSON-1914941808 None] Deleting attachment 5b72623b-4298-4d58-a79a-a28998b715fb. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Flow 'volume_create_manager' (4962a50d-05ef-451f-a809-f24ea9dd4dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c8b917-9149-4365-8856-328b89659245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c8b917-9149-4365-8856-328b89659245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1465321483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f08bee-b572-4f50-9e3f-87bf60557c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4182d43898d34cbcb15855ebbc79f9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:51Z,use_quota=True,user_id='0a46876b7e264104b23fbd6ef0bd563f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65056c4-db84-4653-837b-2c470dbf6a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65056c4-db84-4653-837b-2c470dbf6a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ad3127-ca59-4f16-89f2-11ea4a33beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ad3127-ca59-4f16-89f2-11ea4a33beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f08bee-b572-4f50-9e3f-87bf60557c11', 'volume_name': 'volume-78f08bee-b572-4f50-9e3f-87bf60557c11', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd98fa14-2ffb-452d-845e-4a862d1cb774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd98fa14-2ffb-452d-845e-4a862d1cb774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66baf651-47a0-467f-94a4-4ee9d16ff7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Volume 78f08bee-b572-4f50-9e3f-87bf60557c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f08bee-b572-4f50-9e3f-87bf60557c11', 'volume_size': 1} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1465321483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f08bee-b572-4f50-9e3f-87bf60557c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4182d43898d34cbcb15855ebbc79f9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:51Z,use_quota=True,user_id='0a46876b7e264104b23fbd6ef0bd563f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Creating volume 78f08bee-b572-4f50-9e3f-87bf60557c11 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:51 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:51 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 1073741824 Sep 11 23:01:51 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:51 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 1073741824" returned: 0 in 0.649s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:52 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 Sep 11 23:01:52 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:52 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11" returned: 0 in 0.364s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66baf651-47a0-467f-94a4-4ee9d16ff7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f08bee-b572-4f50-9e3f-87bf60557c11', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbee6be-2292-437f-a8e0-adff99d1ddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:52 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Volume volume-78f08bee-b572-4f50-9e3f-87bf60557c11 (78f08bee-b572-4f50-9e3f-87bf60557c11): created successfully Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbee6be-2292-437f-a8e0-adff99d1ddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Flow 'volume_create_manager' (4962a50d-05ef-451f-a809-f24ea9dd4dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3ac249d9-a5e7-44c6-906b-64661240aa48 tempest-ServersNegativeTestJSON-1822079312 None] Created volume successfully. Sep 11 23:01:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "cinder-78f08bee-b572-4f50-9e3f-87bf60557c11-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-78f08bee-b572-4f50-9e3f-87bf60557c11-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "cinder-quobyte-78f08bee-b572-4f50-9e3f-87bf60557c11" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-quobyte-78f08bee-b572-4f50-9e3f-87bf60557c11" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed706e82-792b-486e-b37b-6452dca472b2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:01:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:54 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 Sep 11 23:01:54 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:55 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11" returned: 0 in 0.665s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:55 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11 Sep 11 23:01:55 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:55 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-78f08bee-b572-4f50-9e3f-87bf60557c11" returned: 0 in 0.438s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-quobyte-78f08bee-b572-4f50-9e3f-87bf60557c11" released by "delete_volume" :: held 1.186s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Created reservations ['f0931015-7cd3-4341-bdab-20adedb0f4d0', '5c48b631-3b16-490b-9f99-e2ca4c5f62a6', 'aef9f72e-9e00-4e42-afe8-e0fe8609e545', 'da580b57-58fc-4135-a3be-c3a3be723826'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:56 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:01:56 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:56 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.344s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Deleted volume successfully. Sep 11 23:01:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f857f21-dd15-4a0c-ad52-1824a5065365 tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-78f08bee-b572-4f50-9e3f-87bf60557c11-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "cinder-501df27d-fd60-4e21-89b3-778a25844029-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-501df27d-fd60-4e21-89b3-778a25844029-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "cinder-quobyte-501df27d-fd60-4e21-89b3-778a25844029" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-quobyte-501df27d-fd60-4e21-89b3-778a25844029" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[64107f0c-5420-4b2c-8c75-4d08f357a825]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:57 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 Sep 11 23:01:57 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:57 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029" returned: 0 in 0.472s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:57 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029 Sep 11 23:01:57 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:58 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-501df27d-fd60-4e21-89b3-778a25844029" returned: 0 in 0.401s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-quobyte-501df27d-fd60-4e21-89b3-778a25844029" released by "delete_volume" :: held 0.948s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Created reservations ['004b7949-9aa8-4304-8caa-3a5a58dec6c0', 'b6d346ed-3cee-45a4-a144-679ad04ec8ef', '199de1d8-144c-497d-a5e2-84e54040ba3a', '2e2da493-e6de-42d6-bbcb-c8997be23048'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:58 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:01:58 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:58 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.287s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Deleted volume successfully. Sep 11 23:01:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fba6372a-5974-4da0-aacd-02745809dbad tempest-ServersNegativeTestJSON-1822079312 None] Lock "cinder-501df27d-fd60-4e21-89b3-778a25844029-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:59 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:01:59 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:59 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:08 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:02:08 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=21,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:02:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-f8d62bf6-3bd1-4713-a6a0-7c9ee9d5650c req-22fa473a-694a-4ab0-8549-fe01010a85e0 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-f8d62bf6-3bd1-4713-a6a0-7c9ee9d5650c req-22fa473a-694a-4ab0-8549-fe01010a85e0 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-f8d62bf6-3bd1-4713-a6a0-7c9ee9d5650c req-22fa473a-694a-4ab0-8549-fe01010a85e0 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-f8d62bf6-3bd1-4713-a6a0-7c9ee9d5650c req-22fa473a-694a-4ab0-8549-fe01010a85e0 tempest-ServerActionsTestOtherA-826692292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-8bb0f923-fef1-4cea-915e-1610663cd2b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '848fce36-6425-4cf1-a18d-a39b336d7dff', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:02:16 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-f8d62bf6-3bd1-4713-a6a0-7c9ee9d5650c req-22fa473a-694a-4ab0-8549-fe01010a85e0 tempest-ServerActionsTestOtherA-826692292 None] attachment_update completed successfully. Sep 11 23:02:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-808b9261-162f-404f-afe6-8b402b445dc4 tempest-ServerActionsTestOtherA-826692292 None] Terminate volume connection completed successfully. Sep 11 23:02:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-808b9261-162f-404f-afe6-8b402b445dc4 tempest-ServerActionsTestOtherA-826692292 None] Deleting attachment 848fce36-6425-4cf1-a18d-a39b336d7dff. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:02:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-b8f2e2ff-69f9-4cb7-bbfe-383ff714362c tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-b8f2e2ff-69f9-4cb7-bbfe-383ff714362c tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-b8f2e2ff-69f9-4cb7-bbfe-383ff714362c tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-b8f2e2ff-69f9-4cb7-bbfe-383ff714362c tempest-ServerActionsTestOtherA-826692292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-8bb0f923-fef1-4cea-915e-1610663cd2b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2227399d-3d97-4d30-b823-658bf35b8a80', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:02:22 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-be49abfe-a048-4b9b-b3ad-8569f9f76777 req-b8f2e2ff-69f9-4cb7-bbfe-383ff714362c tempest-ServerActionsTestOtherA-826692292 None] attachment_update completed successfully. Sep 11 23:02:32 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:02:32 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Acquiring lock "cinder-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "cinder-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Flow 'volume_create_manager' (1cfa1ba8-f608-4595-93be-47bd45c3eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f25781-5596-45e6-ac2d-8d079cd3fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f25781-5596-45e6-ac2d-8d079cd3fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-900132460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f5a9bb26c145e2b1939c6b7c72d34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:51Z,use_quota=True,user_id='aea9b0aa87c742d0bda767bae4daf5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f361a1cd-3a2c-4cdb-b1b1-93c8700c9116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f361a1cd-3a2c-4cdb-b1b1-93c8700c9116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b1b20e-0683-4901-98ef-00693fcc9c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b1b20e-0683-4901-98ef-00693fcc9c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c', 'volume_name': 'volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2316257-e29c-4eef-b00c-8c333a0c452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2316257-e29c-4eef-b00c-8c333a0c452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778b5985-b59e-4ebb-8fd0-6cd7a8bd7669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:50 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Volume 5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c', 'volume_size': 1} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-900132460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f5a9bb26c145e2b1939c6b7c72d34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:51Z,use_quota=True,user_id='aea9b0aa87c742d0bda767bae4daf5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Creating volume 5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:02:50 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Acquiring lock "cinder-quobyte-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:50 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c 1073741824 Sep 11 23:02:50 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "cinder-quobyte-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4af102-7f01-4045-85ca-40befd6ca22e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:51 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b Sep 11 23:02:51 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:51 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b" returned: 0 in 0.498s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:51 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b Sep 11 23:02:51 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:51 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c 1073741824" returned: 0 in 0.620s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:51 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c Sep 11 23:02:51 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-59286a17-61f7-4310-a542-954d65847e9b req-6deab7b3-5956-4f73-9bc7-7960bd78457a tempest-ServerActionsTestOtherA-826692292 None] Terminate volume connection completed successfully. Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-59286a17-61f7-4310-a542-954d65847e9b req-6deab7b3-5956-4f73-9bc7-7960bd78457a tempest-ServerActionsTestOtherA-826692292 None] Deleting attachment 2227399d-3d97-4d30-b823-658bf35b8a80. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:02:51 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:51 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778b5985-b59e-4ebb-8fd0-6cd7a8bd7669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3d597c-0e45-41aa-81a9-649c9bfc8fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b" returned: 0 in 0.439s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "cinder-quobyte-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b" released by "delete_volume" :: held 0.999s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Volume volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c (5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c): created successfully Sep 11 23:02:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3d597c-0e45-41aa-81a9-649c9bfc8fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Flow 'volume_create_manager' (1cfa1ba8-f608-4595-93be-47bd45c3eb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3c2fe092-80d3-4154-9a51-f8ab59f64ac9 tempest-AttachVolumeNegativeTest-1754580533 None] Created volume successfully. Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Created reservations ['90d54e97-e811-488d-a64c-c733dd374c40', 'd8679bea-6f9d-4e84-a4ca-765d1ec4f4eb', 'f3c8aa09-eedf-4d40-919b-bfbcd4accc42', '8f427f31-1391-4b1b-97a5-e5cf5b2da535'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:52 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:02:52 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:52 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.235s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Deleted volume successfully. Sep 11 23:02:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ac0b31ea-d798-4db9-9422-547cf21461dd tempest-AttachVolumeShelveTestJSON-1914941808 None] Lock "cinder-a6be1d11-fd91-4ffb-b132-3fc4cc6ad44b-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-675a4b45-78d5-4a82-ab82-3d7b25aa14d5 req-76e8dd92-7c76-48e4-a0b2-63c63a3d1e31 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-675a4b45-78d5-4a82-ab82-3d7b25aa14d5 req-76e8dd92-7c76-48e4-a0b2-63c63a3d1e31 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-675a4b45-78d5-4a82-ab82-3d7b25aa14d5 req-76e8dd92-7c76-48e4-a0b2-63c63a3d1e31 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-675a4b45-78d5-4a82-ab82-3d7b25aa14d5 req-76e8dd92-7c76-48e4-a0b2-63c63a3d1e31 tempest-AttachVolumeNegativeTest-1754580533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '064f8e57-1e5d-40eb-8b5f-f502718f7c9b', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:02:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-675a4b45-78d5-4a82-ab82-3d7b25aa14d5 req-76e8dd92-7c76-48e4-a0b2-63c63a3d1e31 tempest-AttachVolumeNegativeTest-1754580533 None] attachment_update completed successfully. Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:59 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:02:59 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:59 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 8 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:02:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Flow 'volume_create_manager' (a4f893ad-fd70-4f33-87ce-0d5aced1ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c4bac0-9039-4d12-8fda-da555e7724ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c4bac0-9039-4d12-8fda-da555e7724ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-443191965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286e37b5-376c-4f28-b707-f7b44c3585b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b198f48fc54935b2d95e19de8178c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:00Z,use_quota=True,user_id='4dfd40d388094b95a88b36973d4961ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff40f19-b56d-4bdb-b882-353349e192ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff40f19-b56d-4bdb-b882-353349e192ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16c8eb0-8efe-4253-89c9-c60637b49776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:00 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:03:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16c8eb0-8efe-4253-89c9-c60637b49776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '286e37b5-376c-4f28-b707-f7b44c3585b7', 'volume_name': 'volume-286e37b5-376c-4f28-b707-f7b44c3585b7', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9fc9e2-c8f0-408b-8899-1829e857de80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9fc9e2-c8f0-408b-8899-1829e857de80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8d62f1-d910-478a-807c-64d6eff06a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Volume 286e37b5-376c-4f28-b707-f7b44c3585b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-286e37b5-376c-4f28-b707-f7b44c3585b7', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:03:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Trying to clone 286e37b5-376c-4f28-b707-f7b44c3585b7 from image 1baacf90-ac97-495c-951c-132c1ebb83be at location (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:03:02 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabc864c-dd1a-493e-978d-ca3a9a9f4ba8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:02 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD Sep 11 23:03:02 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:02 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD" returned: 0 in 0.580s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be is fetched for user 4dfd40d388094b95a88b36973d4961ae. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64d3894-4060-424b-8431-09fd18aad366]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:03 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD Sep 11 23:03:03 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:03 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-443191965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286e37b5-376c-4f28-b707-f7b44c3585b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b198f48fc54935b2d95e19de8178c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:00Z,use_quota=True,user_id='4dfd40d388094b95a88b36973d4961ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Creating volume 286e37b5-376c-4f28-b707-f7b44c3585b7 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:03 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:03 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 1073741824 Sep 11 23:03:03 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Flow 'volume_create_manager' (e6cefde2-0802-483b-b123-63c60b8fd98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3021f89-d974-493d-927a-4ca6517a6a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3021f89-d974-493d-927a-4ca6517a6a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-890284128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9126ccbe-dd49-46a6-8420-81f939220f2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e779d04f30734524b07faca827d308f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:04Z,use_quota=True,user_id='9e3e40a7bc924304854e054873f22cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce3a539-fea4-4178-98a7-e550bc1f45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce3a539-fea4-4178-98a7-e550bc1f45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bf02af-eefc-42ee-9878-561b9f05fd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bf02af-eefc-42ee-9878-561b9f05fd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9126ccbe-dd49-46a6-8420-81f939220f2d', 'volume_name': 'volume-9126ccbe-dd49-46a6-8420-81f939220f2d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151dad0d-6468-4bcf-932e-0d56106a5aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151dad0d-6468-4bcf-932e-0d56106a5aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d415d887-da19-4d03-be92-7d3ea205475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Volume 9126ccbe-dd49-46a6-8420-81f939220f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9126ccbe-dd49-46a6-8420-81f939220f2d', 'volume_size': 1} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Flow 'volume_create_manager' (5fa91a29-9901-4cab-b7d2-e18026bf6ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c8d706-5690-4da1-93b1-37e42b9149dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c8d706-5690-4da1-93b1-37e42b9149dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1557586528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef777517-6676-49e5-8801-b113eff41f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be8aea7aeef4e1b98be0db5a118e94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:04Z,use_quota=True,user_id='567611d3f23946d388ead94df1405ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54181a9a-b379-4efd-947e-17d93b28cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54181a9a-b379-4efd-947e-17d93b28cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b667693c-1a0a-4369-8287-7443ed8e6356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b667693c-1a0a-4369-8287-7443ed8e6356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef777517-6676-49e5-8801-b113eff41f13', 'volume_name': 'volume-ef777517-6676-49e5-8801-b113eff41f13', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c5c64a-8c9a-4388-bda1-6f6c99d55de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c5c64a-8c9a-4388-bda1-6f6c99d55de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a49ff-ad4a-494f-b192-b73f065e9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Volume ef777517-6676-49e5-8801-b113eff41f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef777517-6676-49e5-8801-b113eff41f13', 'volume_size': 1} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 1073741824" returned: 0 in 0.645s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:04 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 Sep 11 23:03:04 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:04 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7" returned: 0 in 0.247s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-890284128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9126ccbe-dd49-46a6-8420-81f939220f2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e779d04f30734524b07faca827d308f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:04Z,use_quota=True,user_id='9e3e40a7bc924304854e054873f22cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Creating volume 9126ccbe-dd49-46a6-8420-81f939220f2d {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:04 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:04 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d 1073741824 Sep 11 23:03:04 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Attempting download of 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 286e37b5-376c-4f28-b707-f7b44c3585b7. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c9e84-94b5-47f6-afcf-28644545e4ce]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:04 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt Sep 11 23:03:04 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:04 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt" returned: 0 in 0.404s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:04 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d 1073741824" returned: 0 in 0.506s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:04 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d Sep 11 23:03:04 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:04 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt Sep 11 23:03:04 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:05 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1557586528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef777517-6676-49e5-8801-b113eff41f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be8aea7aeef4e1b98be0db5a118e94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:04Z,use_quota=True,user_id='567611d3f23946d388ead94df1405ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Creating volume ef777517-6676-49e5-8801-b113eff41f13 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:05 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:05 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 1073741824 Sep 11 23:03:05 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d415d887-da19-4d03-be92-7d3ea205475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9126ccbe-dd49-46a6-8420-81f939220f2d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a791de21-0115-450e-9921-338639c1f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Volume volume-9126ccbe-dd49-46a6-8420-81f939220f2d (9126ccbe-dd49-46a6-8420-81f939220f2d): created successfully Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a791de21-0115-450e-9921-338639c1f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:05 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Flow 'volume_create_manager' (e6cefde2-0802-483b-b123-63c60b8fd98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt" returned: 1 in 0.442s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_dc6e1syt' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcf9fa2-db6f-4c28-bd4f-305d8d96e868]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-48ad67e9-939c-4b16-9677-af3ff079cee4 tempest-VolumesTestJSON-579537777 None] Created volume successfully. Sep 11 23:03:05 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD Sep 11 23:03:05 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:05 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] 1baacf90-ac97-495c-951c-132c1ebb83be was qcow2, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:05 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 Sep 11 23:03:05 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:05 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 1073741824" returned: 0 in 0.841s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:06 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 Sep 11 23:03:06 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:06 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13" returned: 0 in 0.361s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a49ff-ad4a-494f-b192-b73f065e9317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef777517-6676-49e5-8801-b113eff41f13', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c106dae-a813-4469-b121-d2a24fa796bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Volume volume-ef777517-6676-49e5-8801-b113eff41f13 (ef777517-6676-49e5-8801-b113eff41f13): created successfully Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c106dae-a813-4469-b121-d2a24fa796bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Flow 'volume_create_manager' (5fa91a29-9901-4cab-b7d2-e18026bf6ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a96ca5c2-5efe-4f56-b7b3-763895f1df0b tempest-AttachVolumeTestJSON-1051598099 None] Created volume successfully. Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Flow 'volume_create_manager' (8d459b6a-879f-414c-8824-e199a3a208e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2128832d-c3d0-4b20-b204-093c24d2b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2128832d-c3d0-4b20-b204-093c24d2b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1679530471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec2cde8-1277-4419-96ee-6d8f4779580e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e779d04f30734524b07faca827d308f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:07Z,use_quota=True,user_id='9e3e40a7bc924304854e054873f22cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87efd898-9c44-4328-88a0-144428663c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87efd898-9c44-4328-88a0-144428663c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694e59c7-b63c-4aad-b232-e6216dbf6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694e59c7-b63c-4aad-b232-e6216dbf6a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec2cde8-1277-4419-96ee-6d8f4779580e', 'volume_name': 'volume-0ec2cde8-1277-4419-96ee-6d8f4779580e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24823611-8ce8-416b-b554-9abbb5167b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24823611-8ce8-416b-b554-9abbb5167b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3deab43b-b5e4-4256-9b80-edfd1bde8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Volume 0ec2cde8-1277-4419-96ee-6d8f4779580e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec2cde8-1277-4419-96ee-6d8f4779580e', 'volume_size': 1} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1679530471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec2cde8-1277-4419-96ee-6d8f4779580e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e779d04f30734524b07faca827d308f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:07Z,use_quota=True,user_id='9e3e40a7bc924304854e054873f22cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Creating volume 0ec2cde8-1277-4419-96ee-6d8f4779580e {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:06 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:03:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:06 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e 1073741824 Sep 11 23:03:06 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:07 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e 1073741824" returned: 0 in 0.811s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:07 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e Sep 11 23:03:07 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:08 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e" returned: 0 in 0.420s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3deab43b-b5e4-4256-9b80-edfd1bde8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec2cde8-1277-4419-96ee-6d8f4779580e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7094b437-666a-450b-beda-8d1c69ce842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5211b094-d8f1-49e4-a169-af503f310704 req-a38faf83-631e-4885-956a-179ec3ff51be tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5211b094-d8f1-49e4-a169-af503f310704 req-a38faf83-631e-4885-956a-179ec3ff51be tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Volume volume-0ec2cde8-1277-4419-96ee-6d8f4779580e (0ec2cde8-1277-4419-96ee-6d8f4779580e): created successfully Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7094b437-666a-450b-beda-8d1c69ce842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Flow 'volume_create_manager' (8d459b6a-879f-414c-8824-e199a3a208e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5211b094-d8f1-49e4-a169-af503f310704 req-a38faf83-631e-4885-956a-179ec3ff51be tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3b3d2e74-1749-4df0-bc97-d9789e9c5724 tempest-VolumesTestJSON-579537777 None] Created volume successfully. Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-5211b094-d8f1-49e4-a169-af503f310704 req-a38faf83-631e-4885-956a-179ec3ff51be tempest-AttachVolumeTestJSON-1051598099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-ef777517-6676-49e5-8801-b113eff41f13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '429a4eba-53c0-4df9-abea-5c2266b67b37', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:03:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-5211b094-d8f1-49e4-a169-af503f310704 req-a38faf83-631e-4885-956a-179ec3ff51be tempest-AttachVolumeTestJSON-1051598099 None] attachment_update completed successfully. Sep 11 23:03:08 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7" returned: 0 in 2.844s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_ki7wmxiddevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:03:08 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Converted 112.00 MB image at 39.35 MB/s Sep 11 23:03:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:08 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 1G Sep 11 23:03:08 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:09 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 1G" returned: 0 in 0.607s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Downloaded image 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 286e37b5-376c-4f28-b707-f7b44c3585b7 successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be for user 4dfd40d388094b95a88b36973d4961ae is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Marking volume 286e37b5-376c-4f28-b707-f7b44c3585b7 as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Copying metadata from image 1baacf90-ac97-495c-951c-132c1ebb83be to 286e37b5-376c-4f28-b707-f7b44c3585b7. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Creating volume glance metadata for volume 286e37b5-376c-4f28-b707-f7b44c3585b7 backed by image 1baacf90-ac97-495c-951c-132c1ebb83be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8d62f1-d910-478a-807c-64d6eff06a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286e37b5-376c-4f28-b707-f7b44c3585b7', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62986dac-3f30-4517-bb24-85e1d716f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:09 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Volume volume-286e37b5-376c-4f28-b707-f7b44c3585b7 (286e37b5-376c-4f28-b707-f7b44c3585b7): created successfully Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62986dac-3f30-4517-bb24-85e1d716f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Flow 'volume_create_manager' (a4f893ad-fd70-4f33-87ce-0d5aced1ef39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-31f236af-1c13-42f9-afe4-563fc1e1fdd2 tempest-ServerActionsTestOtherA-826692292 None] Created volume successfully. Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Flow 'volume_create_manager' (ef69c757-aaa6-4702-b50e-c7bc4c92feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c819642d-8c30-47f6-8519-ca24b7df8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c819642d-8c30-47f6-8519-ca24b7df8526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379524156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd63af5-5a3f-46c7-9c1c-c01ead093eea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e779d04f30734524b07faca827d308f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:10Z,use_quota=True,user_id='9e3e40a7bc924304854e054873f22cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a0bf06-a94a-45cf-b3a2-05bcb88d9613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a0bf06-a94a-45cf-b3a2-05bcb88d9613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579c86b6-bee0-4117-8bf7-4b2f81f6b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579c86b6-bee0-4117-8bf7-4b2f81f6b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd63af5-5a3f-46c7-9c1c-c01ead093eea', 'volume_name': 'volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd42d72-da67-4b97-bdd4-1984e9e2cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd42d72-da67-4b97-bdd4-1984e9e2cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ee5742-e63a-4c37-bf6d-243deae0d2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:09 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Volume ecd63af5-5a3f-46c7-9c1c-c01ead093eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea', 'volume_size': 1} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379524156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd63af5-5a3f-46c7-9c1c-c01ead093eea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e779d04f30734524b07faca827d308f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:10Z,use_quota=True,user_id='9e3e40a7bc924304854e054873f22cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Creating volume ecd63af5-5a3f-46c7-9c1c-c01ead093eea {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:09 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:03:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:09 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea 1073741824 Sep 11 23:03:09 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:10 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea 1073741824" returned: 0 in 0.628s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:10 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea Sep 11 23:03:10 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:10 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea" returned: 0 in 0.437s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ee5742-e63a-4c37-bf6d-243deae0d2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2903a091-60f1-493e-b353-7bc7fe450433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Volume volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea (ecd63af5-5a3f-46c7-9c1c-c01ead093eea): created successfully Sep 11 23:03:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2903a091-60f1-493e-b353-7bc7fe450433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Flow 'volume_create_manager' (ef69c757-aaa6-4702-b50e-c7bc4c92feee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4e18e8b7-ed0f-4379-9fae-0437bb79c621 tempest-VolumesTestJSON-579537777 None] Created volume successfully. Sep 11 23:03:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Acquiring lock "cinder-ecd63af5-5a3f-46c7-9c1c-c01ead093eea-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Lock "cinder-ecd63af5-5a3f-46c7-9c1c-c01ead093eea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Acquiring lock "cinder-quobyte-ecd63af5-5a3f-46c7-9c1c-c01ead093eea" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Lock "cinder-quobyte-ecd63af5-5a3f-46c7-9c1c-c01ead093eea" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f20c36-1a9c-4901-ab22-2e43f4bc001b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:13 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea Sep 11 23:03:13 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:14 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea" returned: 0 in 0.896s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:14 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea Sep 11 23:03:14 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7b379287-907f-41c4-9c82-14b8607605e6 req-ffac4201-2abe-4f87-a500-270c114fe324 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7b379287-907f-41c4-9c82-14b8607605e6 req-ffac4201-2abe-4f87-a500-270c114fe324 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7b379287-907f-41c4-9c82-14b8607605e6 req-ffac4201-2abe-4f87-a500-270c114fe324 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7b379287-907f-41c4-9c82-14b8607605e6 req-ffac4201-2abe-4f87-a500-270c114fe324 tempest-ServerActionsTestOtherA-826692292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-286e37b5-376c-4f28-b707-f7b44c3585b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82973382-b4b8-4d1c-88df-7da18fbacd57', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:03:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-7b379287-907f-41c4-9c82-14b8607605e6 req-ffac4201-2abe-4f87-a500-270c114fe324 tempest-ServerActionsTestOtherA-826692292 None] attachment_update completed successfully. Sep 11 23:03:15 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecd63af5-5a3f-46c7-9c1c-c01ead093eea" returned: 0 in 0.536s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Lock "cinder-quobyte-ecd63af5-5a3f-46c7-9c1c-c01ead093eea" released by "delete_volume" :: held 1.525s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Created reservations ['74237acb-4936-4fd9-ba1f-a7d15dbeb58d', '82364f67-448a-4877-bce3-3d8d3ac7de54', 'f8ab5a80-510b-46d8-af5f-58b4a4df7933', 'f853b024-a7bb-4aac-b1af-c586fad1b912'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:15 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:03:15 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:15 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.362s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Deleted volume successfully. Sep 11 23:03:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5b641330-f575-47c0-be7b-159346e2c4c0 tempest-VolumesTestJSON-579537777 None] Lock "cinder-ecd63af5-5a3f-46c7-9c1c-c01ead093eea-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Acquiring lock "cinder-0ec2cde8-1277-4419-96ee-6d8f4779580e-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Lock "cinder-0ec2cde8-1277-4419-96ee-6d8f4779580e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Acquiring lock "cinder-quobyte-0ec2cde8-1277-4419-96ee-6d8f4779580e" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Lock "cinder-quobyte-0ec2cde8-1277-4419-96ee-6d8f4779580e" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[da634867-8bfc-4c73-9e7d-02b6cc8d121a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:16 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e Sep 11 23:03:16 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:17 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e" returned: 0 in 0.937s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:17 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e Sep 11 23:03:17 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:17 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ec2cde8-1277-4419-96ee-6d8f4779580e" returned: 0 in 0.541s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Lock "cinder-quobyte-0ec2cde8-1277-4419-96ee-6d8f4779580e" released by "delete_volume" :: held 1.562s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Created reservations ['344a9490-0db8-43e1-9a00-e87ba7f35a7b', 'e23cf6be-18b8-4460-b153-5ca125a437ac', '5340d9e5-f594-4eed-9e21-50aca7401b84', 'a10cc6b6-81f6-48ed-aabb-fd1fb4491652'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:18 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:03:18 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Acquiring lock "cinder-9126ccbe-dd49-46a6-8420-81f939220f2d-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Lock "cinder-9126ccbe-dd49-46a6-8420-81f939220f2d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:18 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.785s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Acquiring lock "cinder-quobyte-9126ccbe-dd49-46a6-8420-81f939220f2d" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Deleted volume successfully. Sep 11 23:03:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Lock "cinder-quobyte-9126ccbe-dd49-46a6-8420-81f939220f2d" acquired by "delete_volume" :: waited 0.039s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b98ca9e-0652-4649-8347-44f706a1dddf]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-230ff38d-088c-4a2c-bd22-153a2c4259bb tempest-VolumesTestJSON-579537777 None] Lock "cinder-0ec2cde8-1277-4419-96ee-6d8f4779580e-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:19 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d Sep 11 23:03:19 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:19 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d" returned: 0 in 0.799s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:19 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d Sep 11 23:03:19 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:20 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9126ccbe-dd49-46a6-8420-81f939220f2d" returned: 0 in 0.410s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Lock "cinder-quobyte-9126ccbe-dd49-46a6-8420-81f939220f2d" released by "delete_volume" :: held 1.274s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Created reservations ['449266a5-a594-4fc8-a241-2c336f598d39', 'de14d20b-5865-4957-99f1-b9bbd52501a0', '579fc970-a7bf-4a33-8813-a7be4f30a7f3', 'f6ffc948-bc45-4f1d-a621-bc8c859137c8'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:20 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:03:20 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:20 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.400s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:20 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Deleted volume successfully. Sep 11 23:03:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bc412fd6-3671-4f2f-b975-cf9ceab8bdb8 tempest-VolumesTestJSON-579537777 None] Lock "cinder-9126ccbe-dd49-46a6-8420-81f939220f2d-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:30 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=56,cinder:SELECT=60,cinder:DELETE=6,cinder:INSERT=18 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:03:30 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=61,cinder:UPDATE=57,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:03:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-f255c5bc-d62b-47bd-b4db-c929b1739338 tempest-ServerActionsTestOtherA-826692292 None] Terminate volume connection completed successfully. Sep 11 23:03:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-f255c5bc-d62b-47bd-b4db-c929b1739338 tempest-ServerActionsTestOtherA-826692292 None] Deleting attachment 82973382-b4b8-4d1c-88df-7da18fbacd57. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:03:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-a14345cb-0b8a-43eb-9bd3-f79930886878 req-ce14f66d-db6b-4d23-8d36-21c74bd2fb1d tempest-AttachVolumeNegativeTest-1754580533 None] Terminate volume connection completed successfully. Sep 11 23:03:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-a14345cb-0b8a-43eb-9bd3-f79930886878 req-ce14f66d-db6b-4d23-8d36-21c74bd2fb1d tempest-AttachVolumeNegativeTest-1754580533 None] Deleting attachment 064f8e57-1e5d-40eb-8b5f-f502718f7c9b. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:03:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-fe600824-9e6e-46ba-a8d9-435dd324cf4c tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-fe600824-9e6e-46ba-a8d9-435dd324cf4c tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-fe600824-9e6e-46ba-a8d9-435dd324cf4c tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-fe600824-9e6e-46ba-a8d9-435dd324cf4c tempest-ServerActionsTestOtherA-826692292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-286e37b5-376c-4f28-b707-f7b44c3585b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65773230-9ebf-495d-bc99-0815eb093694', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:03:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-329e8cf1-5643-4f80-9d89-9d8f614df49f req-fe600824-9e6e-46ba-a8d9-435dd324cf4c tempest-ServerActionsTestOtherA-826692292 None] attachment_update completed successfully. Sep 11 23:03:43 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-7531dd21-eb96-42e9-a962-cf5a6a27bcb9 req-0a66db1c-149d-4fa1-84cc-69e33468ec51 tempest-AttachVolumeTestJSON-1051598099 None] Terminate volume connection completed successfully. Sep 11 23:03:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7531dd21-eb96-42e9-a962-cf5a6a27bcb9 req-0a66db1c-149d-4fa1-84cc-69e33468ec51 tempest-AttachVolumeTestJSON-1051598099 None] Deleting attachment 429a4eba-53c0-4df9-abea-5c2266b67b37. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:03:53 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=12,cinder:UPDATE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:03:53 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:59 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:03:59 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:59 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.443s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:03:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Flow 'volume_create_manager' (b479ac3c-9de2-4a16-9069-eb96a7dc21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f43afac-d4b3-4a56-b15f-81f3f12da07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f43afac-d4b3-4a56-b15f-81f3f12da07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-319534601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614f7096-6acf-466d-8630-94b582ab345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44df69c230c496282d77eaa667d75b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:02Z,use_quota=True,user_id='81f158d539d74cc5ac8ae7a2cdc377fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d8099d2-eacf-4369-9dd9-8647caee4a0e),volume_type_id=4d8099d2-eacf-4369-9dd9-8647caee4a0e)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94398c4-14cb-4019-b0a4-38e4e0314c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94398c4-14cb-4019-b0a4-38e4e0314c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9e3564-13e4-4e49-baff-0de0af2fb438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9e3564-13e4-4e49-baff-0de0af2fb438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614f7096-6acf-466d-8630-94b582ab345b', 'volume_name': 'volume-614f7096-6acf-466d-8630-94b582ab345b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92036a4c-9bf5-4151-ac8a-5dc043b3a79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92036a4c-9bf5-4151-ac8a-5dc043b3a79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff717ae-53ae-4f14-9e54-250ca821b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Volume 614f7096-6acf-466d-8630-94b582ab345b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614f7096-6acf-466d-8630-94b582ab345b', 'volume_size': 1} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-319534601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614f7096-6acf-466d-8630-94b582ab345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44df69c230c496282d77eaa667d75b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:02Z,use_quota=True,user_id='81f158d539d74cc5ac8ae7a2cdc377fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d8099d2-eacf-4369-9dd9-8647caee4a0e),volume_type_id=4d8099d2-eacf-4369-9dd9-8647caee4a0e)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Creating volume 614f7096-6acf-466d-8630-94b582ab345b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:01 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:04:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:01 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b 1073741824 Sep 11 23:04:01 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:02 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b 1073741824" returned: 0 in 0.896s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:02 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b Sep 11 23:04:02 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:03 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b" returned: 0 in 0.523s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff717ae-53ae-4f14-9e54-250ca821b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614f7096-6acf-466d-8630-94b582ab345b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8159995e-d663-4032-9b6c-46ff66dfa11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Volume volume-614f7096-6acf-466d-8630-94b582ab345b (614f7096-6acf-466d-8630-94b582ab345b): created successfully Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8159995e-d663-4032-9b6c-46ff66dfa11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Flow 'volume_create_manager' (b479ac3c-9de2-4a16-9069-eb96a7dc21f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-df671eb4-d83a-40b0-bb93-686052c57bf8 tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Created volume successfully. Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:04 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:04:04 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:04 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.266s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:04 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3d324ae6-783b-4714-84ef-27219746726f tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Retype volume completed successfully. Sep 11 23:04:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Acquiring lock "cinder-614f7096-6acf-466d-8630-94b582ab345b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "cinder-614f7096-6acf-466d-8630-94b582ab345b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Acquiring lock "cinder-quobyte-614f7096-6acf-466d-8630-94b582ab345b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "cinder-quobyte-614f7096-6acf-466d-8630-94b582ab345b" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:06 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2ef13-16d9-4977-9abc-39774e081faa]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:06 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b Sep 11 23:04:06 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:06 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b" returned: 0 in 0.578s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:06 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b Sep 11 23:04:06 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:07 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-614f7096-6acf-466d-8630-94b582ab345b" returned: 0 in 0.443s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "cinder-quobyte-614f7096-6acf-466d-8630-94b582ab345b" released by "delete_volume" :: held 1.122s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:07 devstack cinder-volume[88002]: WARNING cinder.quota [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:07 devstack cinder-volume[88002]: WARNING cinder.quota [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Created reservations ['9980aaf4-7b78-4909-b757-699f2045fa37', '33f225bc-0c81-465e-af0a-656ec13153b9', '31e63052-4041-4e06-baa4-15949fea392e', '8137d039-a17a-420b-b571-ea112f403b69'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:07 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:04:07 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:07 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Deleted volume successfully. Sep 11 23:04:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-feb3356f-f977-43bb-86a2-928a9b66a81b tempest-VolumeRetypeWithoutMigrationTest-1705363911 None] Lock "cinder-614f7096-6acf-466d-8630-94b582ab345b-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-93e40150-c6a3-4084-91ce-30f3df9bb8f9 tempest-ServerActionsTestOtherA-826692292 None] Terminate volume connection completed successfully. Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-93e40150-c6a3-4084-91ce-30f3df9bb8f9 tempest-ServerActionsTestOtherA-826692292 None] Deleting attachment 65773230-9ebf-495d-bc99-0815eb093694. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "cinder-286e37b5-376c-4f28-b707-f7b44c3585b7-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-286e37b5-376c-4f28-b707-f7b44c3585b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "cinder-quobyte-286e37b5-376c-4f28-b707-f7b44c3585b7" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-quobyte-286e37b5-376c-4f28-b707-f7b44c3585b7" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6a425-528a-4541-bf40-c4c0481f4084]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:12 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 Sep 11 23:04:12 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:13 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7" returned: 0 in 0.615s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:13 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7 Sep 11 23:04:13 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "cinder-8bb0f923-fef1-4cea-915e-1610663cd2b9-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-8bb0f923-fef1-4cea-915e-1610663cd2b9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "cinder-quobyte-8bb0f923-fef1-4cea-915e-1610663cd2b9" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-quobyte-8bb0f923-fef1-4cea-915e-1610663cd2b9" acquired by "delete_volume" :: waited 0.037s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5ff1d-93aa-4e0b-9252-34bcadb48303]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:13 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-286e37b5-376c-4f28-b707-f7b44c3585b7" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-quobyte-286e37b5-376c-4f28-b707-f7b44c3585b7" released by "delete_volume" :: held 1.102s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:13 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 Sep 11 23:04:13 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.quota [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Created reservations ['660e950e-1adf-4a2d-b699-a938734741b8', 'de16c37a-7960-4415-adde-9ec3fc9715cf', 'b63294b6-4806-4f33-b023-65ef7dd4a3fa', '06f2715f-45e2-4846-8116-f3b90a0bad5e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:13 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:04:13 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:14 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9" returned: 0 in 0.675s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:14 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9 Sep 11 23:04:14 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:14 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG cinder.manager [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Deleted volume successfully. Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-482f4fff-4f1e-49b9-a158-0c6583605eeb req-d93ff636-e1b4-4a24-bd0f-d4079c723ac6 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-286e37b5-376c-4f28-b707-f7b44c3585b7-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:14 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8bb0f923-fef1-4cea-915e-1610663cd2b9" returned: 0 in 0.382s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-quobyte-8bb0f923-fef1-4cea-915e-1610663cd2b9" released by "delete_volume" :: held 1.122s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Created reservations ['164eb1cd-9a2d-431b-8bb4-d65c859741a8', 'fbe82fac-1bbc-440a-93a8-d286e5904a41', 'fef64f65-dc88-48cc-8435-46d9816ad8cd', 'b15845eb-0db4-4e29-8b4c-90f92eccd8d4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:14 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:04:14 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:15 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.323s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:15 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Deleted volume successfully. Sep 11 23:04:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fb97cd05-4498-4d72-be2b-b92d488b4358 tempest-ServerActionsTestOtherA-826692292 None] Lock "cinder-8bb0f923-fef1-4cea-915e-1610663cd2b9-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Flow 'volume_create_manager' (fb719086-468f-4443-b992-d7610deb5734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac21f081-9b78-4876-b386-2c91bb9dd5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac21f081-9b78-4876-b386-2c91bb9dd5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1956379616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519ab2e5-7231-48db-9d9a-75e64813b787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b763ff9c77844d7bf16092d8e2a5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:17Z,use_quota=True,user_id='fff90aab7c4e4d2da5a429c2dac6daa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdade0df-b9ae-4286-ac79-167ebc0221fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdade0df-b9ae-4286-ac79-167ebc0221fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35684efa-3b27-462a-a762-0b05f17dcac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35684efa-3b27-462a-a762-0b05f17dcac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519ab2e5-7231-48db-9d9a-75e64813b787', 'volume_name': 'volume-519ab2e5-7231-48db-9d9a-75e64813b787', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81f0592-bfde-4582-97f4-ff6a2fa4313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81f0592-bfde-4582-97f4-ff6a2fa4313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8604be7-385d-4b2a-99f7-a57c342dfa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:16 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Volume 519ab2e5-7231-48db-9d9a-75e64813b787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519ab2e5-7231-48db-9d9a-75e64813b787', 'volume_size': 1} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1956379616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519ab2e5-7231-48db-9d9a-75e64813b787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b763ff9c77844d7bf16092d8e2a5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:17Z,use_quota=True,user_id='fff90aab7c4e4d2da5a429c2dac6daa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Creating volume 519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:16 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:04:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:16 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 1073741824 Sep 11 23:04:16 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:17 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 1073741824" returned: 0 in 0.445s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:17 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 Sep 11 23:04:17 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:17 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8604be7-385d-4b2a-99f7-a57c342dfa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519ab2e5-7231-48db-9d9a-75e64813b787', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feae013-f502-4651-b5a4-ceabe65fc012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:17 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Volume volume-519ab2e5-7231-48db-9d9a-75e64813b787 (519ab2e5-7231-48db-9d9a-75e64813b787): created successfully Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feae013-f502-4651-b5a4-ceabe65fc012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Flow 'volume_create_manager' (fb719086-468f-4443-b992-d7610deb5734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6223a1a7-e9a4-4b89-990e-62a21ca3063a tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Created volume successfully. Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Creating offline snapshot f3283ab5-bb27-4665-8c99-d035f6d18720 of volume 519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f6c856-ed08-49a6-8d4b-bfefc74ba1c7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:19 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 Sep 11 23:04:19 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:19 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:19 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 1G Sep 11 23:04:19 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:19 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 1G" returned: 0 in 0.466s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-519ab2e5-7231-48db-9d9a-75e64813b787 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:20 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-519ab2e5-7231-48db-9d9a-75e64813b787 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 Sep 11 23:04:20 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:20 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-519ab2e5-7231-48db-9d9a-75e64813b787 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720" returned: 0 in 0.297s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 is being set with open permissions: ugo+rw Sep 11 23:04:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:20 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 Sep 11 23:04:20 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:20 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:20 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info Sep 11 23:04:20 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:20 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info" returned: 0 in 0.252s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info is being set with open permissions: ugo+rw Sep 11 23:04:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:20 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info Sep 11 23:04:20 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:21 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.info" returned: 0 in 0.253s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-689ca292-9e52-4d3d-aac0-18ef56b18941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Create snapshot completed successfully Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "cinder-f3283ab5-bb27-4665-8c99-d035f6d18720-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-f3283ab5-bb27-4665-8c99-d035f6d18720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "cinder-quobyte-519ab2e5-7231-48db-9d9a-75e64813b787" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-quobyte-519ab2e5-7231-48db-9d9a-75e64813b787" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "cinder-quobyte-f3283ab5-bb27-4665-8c99-d035f6d18720" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-quobyte-f3283ab5-bb27-4665-8c99-d035f6d18720" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Deleting offline snapshot f3283ab5-bb27-4665-8c99-d035f6d18720 of volume 519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] snapshot_file for this snap is: volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1f876-7f31-40e6-ba64-b0b75d918e05]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:21 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 Sep 11 23:04:21 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:22 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720" returned: 0 in 0.337s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-519ab2e5-7231-48db-9d9a-75e64813b787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad18b6e-317b-46ad-a68a-fcceea35e6ca]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:22 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 Sep 11 23:04:22 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:22 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787" returned: 0 in 0.375s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:22 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 Sep 11 23:04:22 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:22 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720" returned: 0 in 0.390s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:22 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720 Sep 11 23:04:22 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:23 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787.f3283ab5-bb27-4665-8c99-d035f6d18720" returned: 0 in 0.249s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-quobyte-f3283ab5-bb27-4665-8c99-d035f6d18720" released by "_delete_snapshot" :: held 1.459s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-quobyte-519ab2e5-7231-48db-9d9a-75e64813b787" released by "delete_snapshot" :: held 1.481s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:23 devstack cinder-volume[88002]: WARNING cinder.quota [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Created reservations ['f17a116e-8f84-4724-8f43-81018c83e120', 'f7322d49-434f-4b78-8f2f-f9e3fcda520b', '926dea9a-df97-4497-9e7f-beac469dc83f', '1d0de29e-d9dc-4d67-b04b-a2a2537928fa'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Delete snapshot completed successfully. Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a08d8320-ed29-4cbf-b054-57bebb43dca8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-f3283ab5-bb27-4665-8c99-d035f6d18720-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "cinder-519ab2e5-7231-48db-9d9a-75e64813b787-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-519ab2e5-7231-48db-9d9a-75e64813b787-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "cinder-quobyte-519ab2e5-7231-48db-9d9a-75e64813b787" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-quobyte-519ab2e5-7231-48db-9d9a-75e64813b787" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb3c74-19f3-49bb-bc08-51588ef5de0d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:24 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 Sep 11 23:04:24 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:24 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787" returned: 0 in 0.417s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:24 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787 Sep 11 23:04:24 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:24 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-519ab2e5-7231-48db-9d9a-75e64813b787" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-quobyte-519ab2e5-7231-48db-9d9a-75e64813b787" released by "delete_volume" :: held 0.759s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Created reservations ['f17d73cd-da17-4857-8b02-3e2e659ed799', '60681a5e-5c8c-47e5-a917-c4acdca6766a', '72be92ba-ca3e-4a4d-bf57-a750cbcf02dd', 'd7af2629-f7bc-49f2-a082-a5e93212846a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:25 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:04:25 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:25 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.294s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:25 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:25 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Deleted volume successfully. Sep 11 23:04:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-128645af-a340-4bfe-b792-29180db81567 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880320561 None] Lock "cinder-519ab2e5-7231-48db-9d9a-75e64813b787-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Flow 'volume_create_manager' (26d472cb-ae4e-4a33-8cd0-731b5b90bd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b25d893-33be-4755-b06e-cb0832c73179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b25d893-33be-4755-b06e-cb0832c73179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703289187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d63d8a-4e79-405d-b759-194922fe6478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f5a9bb26c145e2b1939c6b7c72d34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:28Z,use_quota=True,user_id='aea9b0aa87c742d0bda767bae4daf5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69be636c-4d85-4820-b6dd-a643b5fcb443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69be636c-4d85-4820-b6dd-a643b5fcb443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70262b32-e70f-4599-af11-1817e02f7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70262b32-e70f-4599-af11-1817e02f7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d63d8a-4e79-405d-b759-194922fe6478', 'volume_name': 'volume-06d63d8a-4e79-405d-b759-194922fe6478', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5909a647-6889-4e90-adf3-a1e50014a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5909a647-6889-4e90-adf3-a1e50014a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e211ad3-2782-4c88-94c1-f5c90430c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:27 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Volume 06d63d8a-4e79-405d-b759-194922fe6478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d63d8a-4e79-405d-b759-194922fe6478', 'volume_size': 1} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703289187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d63d8a-4e79-405d-b759-194922fe6478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f5a9bb26c145e2b1939c6b7c72d34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:28Z,use_quota=True,user_id='aea9b0aa87c742d0bda767bae4daf5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Creating volume 06d63d8a-4e79-405d-b759-194922fe6478 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:27 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:04:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:27 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 1073741824 Sep 11 23:04:27 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:28 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 1073741824" returned: 0 in 0.536s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:28 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 Sep 11 23:04:28 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:28 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e211ad3-2782-4c88-94c1-f5c90430c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d63d8a-4e79-405d-b759-194922fe6478', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74dffc2-a934-4158-8922-0c09c9fe8fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:28 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Volume volume-06d63d8a-4e79-405d-b759-194922fe6478 (06d63d8a-4e79-405d-b759-194922fe6478): created successfully Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74dffc2-a934-4158-8922-0c09c9fe8fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Flow 'volume_create_manager' (26d472cb-ae4e-4a33-8cd0-731b5b90bd6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7c7034f7-8487-4e87-a56e-5ec06d2eadba tempest-AttachVolumeNegativeTest-1754580533 None] Created volume successfully. Sep 11 23:04:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-11603a0f-1684-4053-befd-8b745b38c016 req-170d9c25-4bfd-4afb-9467-21ec34681e0e tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-11603a0f-1684-4053-befd-8b745b38c016 req-170d9c25-4bfd-4afb-9467-21ec34681e0e tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-11603a0f-1684-4053-befd-8b745b38c016 req-170d9c25-4bfd-4afb-9467-21ec34681e0e tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-11603a0f-1684-4053-befd-8b745b38c016 req-170d9c25-4bfd-4afb-9467-21ec34681e0e tempest-AttachVolumeNegativeTest-1754580533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-06d63d8a-4e79-405d-b759-194922fe6478', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a586d1a-663f-43e4-8098-7c3fc1718475', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:04:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-11603a0f-1684-4053-befd-8b745b38c016 req-170d9c25-4bfd-4afb-9467-21ec34681e0e tempest-AttachVolumeNegativeTest-1754580533 None] attachment_update completed successfully. Sep 11 23:04:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-36af36a6-cd30-479c-949d-20d6402389c2 req-0f6e8e30-9926-433c-9e03-00a9ffc4eb8b tempest-AttachVolumeNegativeTest-1754580533 None] Terminate volume connection completed successfully. Sep 11 23:04:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-36af36a6-cd30-479c-949d-20d6402389c2 req-0f6e8e30-9926-433c-9e03-00a9ffc4eb8b tempest-AttachVolumeNegativeTest-1754580533 None] Deleting attachment 4a586d1a-663f-43e4-8098-7c3fc1718475. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:04:52 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=57,cinder:SELECT=45,cinder:INSERT=9,cinder:DELETE=6 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:04:52 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=57,cinder:UPDATE=52,cinder:DELETE=2,cinder:INSERT=15 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:59 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:04:59 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:59 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.496s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:04:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Flow 'volume_create_manager' (64237991-bb80-43bc-bfab-d3096f2da693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1c9401-2f0b-4662-8139-074f9da01a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1c9401-2f0b-4662-8139-074f9da01a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1038491184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0211a05-c4c3-4645-91fc-ae001e26c4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec5ff64bdc46dd8f08ccb3f5b551a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:24Z,use_quota=True,user_id='ca6adf77c70d455cad0feff02a3603ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee298649-068b-489f-866d-11e60ef45e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee298649-068b-489f-866d-11e60ef45e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5b19ec-000d-4e48-a001-aa6fd5385c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5b19ec-000d-4e48-a001-aa6fd5385c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0211a05-c4c3-4645-91fc-ae001e26c4b2', 'volume_name': 'volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6e5e0f-0d73-43a4-a3a1-a84a32d67cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6e5e0f-0d73-43a4-a3a1-a84a32d67cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdacf146-3cda-4156-aeec-61f431d3da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:24 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Volume b0211a05-c4c3-4645-91fc-ae001e26c4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2', 'volume_size': 1} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1038491184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0211a05-c4c3-4645-91fc-ae001e26c4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ec5ff64bdc46dd8f08ccb3f5b551a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:24Z,use_quota=True,user_id='ca6adf77c70d455cad0feff02a3603ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Creating volume b0211a05-c4c3-4645-91fc-ae001e26c4b2 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:24 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:24 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 1073741824 Sep 11 23:05:24 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:25 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 1073741824" returned: 0 in 0.808s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:25 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 Sep 11 23:05:25 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:26 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2" returned: 0 in 0.798s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdacf146-3cda-4156-aeec-61f431d3da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c60f80f-a26e-48f8-85ad-6726127eaa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:26 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Volume volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 (b0211a05-c4c3-4645-91fc-ae001e26c4b2): created successfully Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c60f80f-a26e-48f8-85ad-6726127eaa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Flow 'volume_create_manager' (64237991-bb80-43bc-bfab-d3096f2da693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:26 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2ed376cb-dd62-4a3b-9640-9f6e8bd28c12 tempest-ServerRescueNegativeTestJSON-1562502215 None] Created volume successfully. Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Flow 'volume_create_manager' (d1dfbd76-78a9-42c7-8b7b-d8202b6574ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ace5200-74bb-41ec-b6ea-d179879ad0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ace5200-74bb-41ec-b6ea-d179879ad0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-533729793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efcc227-63a9-4c50-98b2-4b13d9657ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be8aea7aeef4e1b98be0db5a118e94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:30Z,use_quota=True,user_id='567611d3f23946d388ead94df1405ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17433204-acb9-4950-a815-3a6af0463f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17433204-acb9-4950-a815-3a6af0463f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd90be5-0d89-48f1-a956-019a7a973853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd90be5-0d89-48f1-a956-019a7a973853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efcc227-63a9-4c50-98b2-4b13d9657ff4', 'volume_name': 'volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfe3887-76a2-44ec-b993-262cda58f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfe3887-76a2-44ec-b993-262cda58f633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6af3346-a55f-4ecc-9cb7-c4abdd97d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:29 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Volume 1efcc227-63a9-4c50-98b2-4b13d9657ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4', 'volume_size': 1} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-533729793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efcc227-63a9-4c50-98b2-4b13d9657ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be8aea7aeef4e1b98be0db5a118e94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:30Z,use_quota=True,user_id='567611d3f23946d388ead94df1405ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Creating volume 1efcc227-63a9-4c50-98b2-4b13d9657ff4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:29 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:29 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 1073741824 Sep 11 23:05:29 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:30 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 1073741824" returned: 0 in 0.816s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:30 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 Sep 11 23:05:30 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:31 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4" returned: 0 in 0.436s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6af3346-a55f-4ecc-9cb7-c4abdd97d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193f15a0-f40f-4f31-8cfd-6a8349eded83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Volume volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 (1efcc227-63a9-4c50-98b2-4b13d9657ff4): created successfully Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193f15a0-f40f-4f31-8cfd-6a8349eded83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Flow 'volume_create_manager' (d1dfbd76-78a9-42c7-8b7b-d8202b6574ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-28731c4e-6804-4d7d-a229-dbb02a312b65 tempest-AttachVolumeTestJSON-1051598099 None] Created volume successfully. Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (60253ea2-07a9-42b5-9b46-06746319b83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2237315-64fa-4029-9246-7603ecda0b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2237315-64fa-4029-9246-7603ecda0b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986502841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e439f389-fec4-47bd-b907-d4a49b31cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:32Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f0a6e3-93f2-40ac-9f36-6fd0eb927426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f0a6e3-93f2-40ac-9f36-6fd0eb927426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bc5a43-e386-451d-93f9-8cf19d9fb96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bc5a43-e386-451d-93f9-8cf19d9fb96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e439f389-fec4-47bd-b907-d4a49b31cdfe', 'volume_name': 'volume-e439f389-fec4-47bd-b907-d4a49b31cdfe', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bda9a3-ead5-4cc2-9e33-4f72979eb152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bda9a3-ead5-4cc2-9e33-4f72979eb152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0d1f60-a89b-4ad2-878e-d3693b30be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:32 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Volume e439f389-fec4-47bd-b907-d4a49b31cdfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e439f389-fec4-47bd-b907-d4a49b31cdfe', 'volume_size': 1} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986502841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e439f389-fec4-47bd-b907-d4a49b31cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:32Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Creating volume e439f389-fec4-47bd-b907-d4a49b31cdfe {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:32 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:33 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe 1073741824 Sep 11 23:05:33 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:33 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe 1073741824" returned: 0 in 0.944s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:33 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe Sep 11 23:05:33 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-afbf4c12-146b-4e0d-a7ae-0defcdf28e1c req-da614a39-3730-47d1-be7e-dc668695d7c4 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:34 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe" returned: 0 in 0.589s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-afbf4c12-146b-4e0d-a7ae-0defcdf28e1c req-da614a39-3730-47d1-be7e-dc668695d7c4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.069s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0d1f60-a89b-4ad2-878e-d3693b30be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e439f389-fec4-47bd-b907-d4a49b31cdfe', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1611f582-1d2b-4b9f-8e9d-bf3ed583aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-afbf4c12-146b-4e0d-a7ae-0defcdf28e1c req-da614a39-3730-47d1-be7e-dc668695d7c4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:34 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Volume volume-e439f389-fec4-47bd-b907-d4a49b31cdfe (e439f389-fec4-47bd-b907-d4a49b31cdfe): created successfully Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1611f582-1d2b-4b9f-8e9d-bf3ed583aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (60253ea2-07a9-42b5-9b46-06746319b83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e82bf01d-c399-4314-a4d7-39e278f45eaa tempest-VolumesActionsTest-2099203051 None] Created volume successfully. Sep 11 23:05:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-afbf4c12-146b-4e0d-a7ae-0defcdf28e1c req-da614a39-3730-47d1-be7e-dc668695d7c4 tempest-AttachVolumeTestJSON-1051598099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31e13a32-109c-4637-88c4-2df4e0e2e29a', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:05:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-afbf4c12-146b-4e0d-a7ae-0defcdf28e1c req-da614a39-3730-47d1-be7e-dc668695d7c4 tempest-AttachVolumeTestJSON-1051598099 None] attachment_update completed successfully. Sep 11 23:05:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3777990f-a6d0-4cd2-8a64-8fc1b8fe322e tempest-VolumesActionsTest-2099203051 None] Acquiring lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe" by "attach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3777990f-a6d0-4cd2-8a64-8fc1b8fe322e tempest-VolumesActionsTest-2099203051 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe" acquired by "attach_volume" :: waited 0.068s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3777990f-a6d0-4cd2-8a64-8fc1b8fe322e tempest-VolumesActionsTest-2099203051 None] Attaching volume e439f389-fec4-47bd-b907-d4a49b31cdfe to instance 4f0ef82f-c593-4b01-b54d-30a2a10fe29d at mountpoint /dev/vdb on host None. Sep 11 23:05:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3777990f-a6d0-4cd2-8a64-8fc1b8fe322e tempest-VolumesActionsTest-2099203051 None] Attach volume completed successfully. Sep 11 23:05:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3777990f-a6d0-4cd2-8a64-8fc1b8fe322e tempest-VolumesActionsTest-2099203051 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe" released by "attach_volume" :: held 0.167s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7b29f15d-3276-4e9d-853d-6f3d0fc61849 tempest-VolumesActionsTest-978552773 None] Terminate volume connection completed successfully. Sep 11 23:05:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7b29f15d-3276-4e9d-853d-6f3d0fc61849 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-detach_volume" by "detach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7b29f15d-3276-4e9d-853d-6f3d0fc61849 tempest-VolumesActionsTest-978552773 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7b29f15d-3276-4e9d-853d-6f3d0fc61849 tempest-VolumesActionsTest-978552773 None] Detaching volume e439f389-fec4-47bd-b907-d4a49b31cdfe from instance 4f0ef82f-c593-4b01-b54d-30a2a10fe29d. Sep 11 23:05:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7b29f15d-3276-4e9d-853d-6f3d0fc61849 tempest-VolumesActionsTest-978552773 None] Detach volume completed successfully. Sep 11 23:05:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7b29f15d-3276-4e9d-853d-6f3d0fc61849 tempest-VolumesActionsTest-978552773 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3059491-a2b1-404b-8279-5f7415540cca tempest-VolumesActionsTest-2099203051 None] Acquiring lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-detach_volume" by "detach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3059491-a2b1-404b-8279-5f7415540cca tempest-VolumesActionsTest-2099203051 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d3059491-a2b1-404b-8279-5f7415540cca tempest-VolumesActionsTest-2099203051 None] Volume detach called, but volume not attached. Sep 11 23:05:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3059491-a2b1-404b-8279-5f7415540cca tempest-VolumesActionsTest-2099203051 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Acquiring lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Acquiring lock "cinder-quobyte-e439f389-fec4-47bd-b907-d4a49b31cdfe" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Lock "cinder-quobyte-e439f389-fec4-47bd-b907-d4a49b31cdfe" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f759ee-dfcf-46cb-86cf-71aab422e684]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:38 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe Sep 11 23:05:38 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:39 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Flow 'volume_create_manager' (313413a1-460a-4a60-9169-5cd2acb2291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce49ea7a-c40d-4e82-9476-0169a7c45415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe" returned: 0 in 0.862s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce49ea7a-c40d-4e82-9476-0169a7c45415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-827845730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0ed385-cf72-4336-919e-ad004847a576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be8aea7aeef4e1b98be0db5a118e94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:39Z,use_quota=True,user_id='567611d3f23946d388ead94df1405ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b71539-e048-4944-bafc-acf03f19322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b71539-e048-4944-bafc-acf03f19322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de88d501-ca67-4e0c-a769-fdc44524acfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:39 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de88d501-ca67-4e0c-a769-fdc44524acfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0ed385-cf72-4336-919e-ad004847a576', 'volume_name': 'volume-cd0ed385-cf72-4336-919e-ad004847a576', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:39 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a260cf6f-8e60-4615-8f1d-1d463c2b6208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a260cf6f-8e60-4615-8f1d-1d463c2b6208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a9df81-4a86-4447-9c5f-ec2bf1331859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Volume cd0ed385-cf72-4336-919e-ad004847a576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0ed385-cf72-4336-919e-ad004847a576', 'volume_size': 1} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-827845730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0ed385-cf72-4336-919e-ad004847a576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be8aea7aeef4e1b98be0db5a118e94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:39Z,use_quota=True,user_id='567611d3f23946d388ead94df1405ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Creating volume cd0ed385-cf72-4336-919e-ad004847a576 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:39 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:39 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 1073741824 Sep 11 23:05:39 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:39 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e439f389-fec4-47bd-b907-d4a49b31cdfe" returned: 0 in 0.843s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Lock "cinder-quobyte-e439f389-fec4-47bd-b907-d4a49b31cdfe" released by "delete_volume" :: held 1.847s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Acquiring lock "cinder-b0211a05-c4c3-4645-91fc-ae001e26c4b2-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "cinder-b0211a05-c4c3-4645-91fc-ae001e26c4b2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Created reservations ['ccc2773f-f5ac-41bf-846b-080dc95a5321', '3f7f33c4-04ec-45d2-a49d-04b803b22b3c', '74c5d44d-593f-450f-a96b-21a2815d1fd9', '6bd39847-5589-4e3f-b5eb-8b22c6213937'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Acquiring lock "cinder-quobyte-b0211a05-c4c3-4645-91fc-ae001e26c4b2" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "cinder-quobyte-b0211a05-c4c3-4645-91fc-ae001e26c4b2" acquired by "delete_volume" :: waited 0.045s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:40 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 1073741824" returned: 0 in 1.061s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcfbc52-3c0a-459e-a8af-3114dc539133]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:40 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 Sep 11 23:05:40 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:40 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:40 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:40 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 Sep 11 23:05:40 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:40 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576" returned: 0 in 0.408s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a9df81-4a86-4447-9c5f-ec2bf1331859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0ed385-cf72-4336-919e-ad004847a576', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2b7ac6-83a1-4556-bafa-f4d59bdc5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:41 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Volume volume-cd0ed385-cf72-4336-919e-ad004847a576 (cd0ed385-cf72-4336-919e-ad004847a576): created successfully Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2b7ac6-83a1-4556-bafa-f4d59bdc5b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Flow 'volume_create_manager' (313413a1-460a-4a60-9169-5cd2acb2291c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-da35b9ed-9e6d-4ea4-9485-b0d3842f3663 tempest-AttachVolumeTestJSON-1051598099 None] Created volume successfully. Sep 11 23:05:41 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.878s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:41 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2" returned: 0 in 1.045s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Deleted volume successfully. Sep 11 23:05:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-691dce5b-c5e4-42f6-8ffe-ea921732d8bc tempest-VolumesActionsTest-2099203051 None] Lock "cinder-e439f389-fec4-47bd-b907-d4a49b31cdfe-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:41 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2 Sep 11 23:05:41 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:42 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b0211a05-c4c3-4645-91fc-ae001e26c4b2" returned: 0 in 0.882s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "cinder-quobyte-b0211a05-c4c3-4645-91fc-ae001e26c4b2" released by "delete_volume" :: held 1.998s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Created reservations ['594a1915-be2a-4d9a-a2c5-d3c4cc3000e3', '24ec0df7-5f62-439c-b40b-5734eb35ce0b', '5ecd32a1-8652-4ad9-b034-3f916a97cbcb', '2dfe4cbc-ac04-4e35-99c9-e5cf9c0ed070'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:42 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:42 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:43 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.787s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:43 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:43 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Deleted volume successfully. Sep 11 23:05:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-88ffb354-b9f2-4f7c-a0cb-5743d00dcbd8 tempest-ServerRescueNegativeTestJSON-1562502215 None] Lock "cinder-b0211a05-c4c3-4645-91fc-ae001e26c4b2-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-3409c628-ac2b-4ac7-b808-176680b3caf1 req-db17c955-e8ee-490b-a2cc-d3b42742b459 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-3409c628-ac2b-4ac7-b808-176680b3caf1 req-db17c955-e8ee-490b-a2cc-d3b42742b459 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-3409c628-ac2b-4ac7-b808-176680b3caf1 req-db17c955-e8ee-490b-a2cc-d3b42742b459 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-3409c628-ac2b-4ac7-b808-176680b3caf1 req-db17c955-e8ee-490b-a2cc-d3b42742b459 tempest-AttachVolumeTestJSON-1051598099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-cd0ed385-cf72-4336-919e-ad004847a576', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfb42e8a-7b45-4735-9391-bfcc08f45162', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:05:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-3409c628-ac2b-4ac7-b808-176680b3caf1 req-db17c955-e8ee-490b-a2cc-d3b42742b459 tempest-AttachVolumeTestJSON-1051598099 None] attachment_update completed successfully. Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (691b0274-ebad-4dea-a4d2-95c056c0dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191f0c36-0ca0-49d8-8550-8ee0fa6df316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191f0c36-0ca0-49d8-8550-8ee0fa6df316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115098775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3353fd-940b-436c-91e7-5a8aae082c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:47Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152518db-33e4-4c29-a1b3-dc48e5102040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152518db-33e4-4c29-a1b3-dc48e5102040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed72ec33-619e-46f0-9d53-45437cac59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed72ec33-619e-46f0-9d53-45437cac59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3353fd-940b-436c-91e7-5a8aae082c0c', 'volume_name': 'volume-8a3353fd-940b-436c-91e7-5a8aae082c0c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be14c4-6a05-4b37-9aaf-1f4a2c395bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be14c4-6a05-4b37-9aaf-1f4a2c395bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8010c0c9-37a3-4b1a-90f1-d1e3c61ce3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Volume 8a3353fd-940b-436c-91e7-5a8aae082c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3353fd-940b-436c-91e7-5a8aae082c0c', 'volume_size': 1} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115098775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3353fd-940b-436c-91e7-5a8aae082c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:47Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Creating volume 8a3353fd-940b-436c-91e7-5a8aae082c0c {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:47 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:47 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c 1073741824 Sep 11 23:05:47 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-e63500dd-ce7e-4dd9-ad8b-36a29c87b3eb req-e3b72dd6-7131-4774-8ecf-7f37e914799c tempest-AttachVolumeTestJSON-1051598099 None] Terminate volume connection completed successfully. Sep 11 23:05:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-e63500dd-ce7e-4dd9-ad8b-36a29c87b3eb req-e3b72dd6-7131-4774-8ecf-7f37e914799c tempest-AttachVolumeTestJSON-1051598099 None] Deleting attachment 31e13a32-109c-4637-88c4-2df4e0e2e29a. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:05:48 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c 1073741824" returned: 0 in 0.579s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:48 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c Sep 11 23:05:48 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:48 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c" returned: 0 in 0.354s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8010c0c9-37a3-4b1a-90f1-d1e3c61ce3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3353fd-940b-436c-91e7-5a8aae082c0c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd0dbb3-2640-4c47-b117-2ffe6c4dd54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:48 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Volume volume-8a3353fd-940b-436c-91e7-5a8aae082c0c (8a3353fd-940b-436c-91e7-5a8aae082c0c): created successfully Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd0dbb3-2640-4c47-b117-2ffe6c4dd54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (691b0274-ebad-4dea-a4d2-95c056c0dcde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fa3adfc3-7921-429a-b4e3-6f18db0221ec tempest-VolumesActionsTest-2099203051 None] Created volume successfully. Sep 11 23:05:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-15265622-d43b-4b07-a0cc-9265945eac3c req-ff82b4eb-f842-4761-8d7e-13c8b818a3b2 tempest-AttachVolumeTestJSON-1051598099 None] Terminate volume connection completed successfully. Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-15265622-d43b-4b07-a0cc-9265945eac3c req-ff82b4eb-f842-4761-8d7e-13c8b818a3b2 tempest-AttachVolumeTestJSON-1051598099 None] Deleting attachment dfb42e8a-7b45-4735-9391-bfcc08f45162. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-8a3353fd-940b-436c-91e7-5a8aae082c0c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Lock "cinder-8a3353fd-940b-436c-91e7-5a8aae082c0c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-quobyte-8a3353fd-940b-436c-91e7-5a8aae082c0c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-8a3353fd-940b-436c-91e7-5a8aae082c0c" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[851816a5-5b31-4f38-a363-fbef60cdfba9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:49 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c Sep 11 23:05:49 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:50 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c" returned: 0 in 0.365s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:50 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c Sep 11 23:05:50 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:50 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8a3353fd-940b-436c-91e7-5a8aae082c0c" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-8a3353fd-940b-436c-91e7-5a8aae082c0c" released by "delete_volume" :: held 0.683s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Created reservations ['a7d5adb8-16bb-4689-9a9d-a411a466eb04', 'a8be6032-079a-4bc9-96c1-ffd391051d9a', '07e2ac99-2dcd-4702-8e00-0f18261a0bff', '3fef502a-f628-46a1-9d45-f753cd22ff3e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:50 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:50 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:51 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.485s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Deleted volume successfully. Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c0cabfc5-6a4e-400f-b6b1-2a7a4b474d46 tempest-VolumesActionsTest-978552773 None] Lock "cinder-8a3353fd-940b-436c-91e7-5a8aae082c0c-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (7373cdec-80c7-436c-ac00-d0860186c412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dd1656-5ce8-4f95-96b9-0ffad2f425f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dd1656-5ce8-4f95-96b9-0ffad2f425f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1548653636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d219b48-fd38-458a-aad8-99d34c7de6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:52Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49294ad-1fd4-4e3a-9257-7b6eb8ccfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49294ad-1fd4-4e3a-9257-7b6eb8ccfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c53e34-f0d1-4e1b-bba6-af0c073a637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c53e34-f0d1-4e1b-bba6-af0c073a637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d219b48-fd38-458a-aad8-99d34c7de6ca', 'volume_name': 'volume-7d219b48-fd38-458a-aad8-99d34c7de6ca', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a574b6a-695b-4d2f-acdf-24d88d771513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a574b6a-695b-4d2f-acdf-24d88d771513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d001c13f-5d3b-416b-864c-d37a70fb6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Volume 7d219b48-fd38-458a-aad8-99d34c7de6ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d219b48-fd38-458a-aad8-99d34c7de6ca', 'volume_size': 1} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1548653636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d219b48-fd38-458a-aad8-99d34c7de6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:52Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Creating volume 7d219b48-fd38-458a-aad8-99d34c7de6ca {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:51 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:51 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca 1073741824 Sep 11 23:05:51 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:52 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca 1073741824" returned: 0 in 0.621s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:52 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca Sep 11 23:05:52 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:52 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d001c13f-5d3b-416b-864c-d37a70fb6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d219b48-fd38-458a-aad8-99d34c7de6ca', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df59d57c-f040-4b78-b974-587814dec6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:52 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Volume volume-7d219b48-fd38-458a-aad8-99d34c7de6ca (7d219b48-fd38-458a-aad8-99d34c7de6ca): created successfully Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df59d57c-f040-4b78-b974-587814dec6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (7373cdec-80c7-436c-ac00-d0860186c412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8bfd4310-8cb5-4fb6-b048-d31764cf1d3c tempest-VolumesActionsTest-2099203051 None] Created volume successfully. Sep 11 23:05:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-7d219b48-fd38-458a-aad8-99d34c7de6ca-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Lock "cinder-7d219b48-fd38-458a-aad8-99d34c7de6ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-quobyte-7d219b48-fd38-458a-aad8-99d34c7de6ca" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-7d219b48-fd38-458a-aad8-99d34c7de6ca" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6c4b26-f3be-4b8a-8df2-7955bd5c34c7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:54 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca Sep 11 23:05:54 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:54 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:54 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca Sep 11 23:05:54 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:54 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d219b48-fd38-458a-aad8-99d34c7de6ca" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-7d219b48-fd38-458a-aad8-99d34c7de6ca" released by "delete_volume" :: held 0.793s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Created reservations ['1a25ea14-4984-469e-8083-52d7f7b1ef51', 'd706f62c-9867-41e9-9412-b8b45ac55613', 'f1fbe010-0f81-43e9-8903-3b4c3c812266', 'd594e0d3-7ed8-414f-a2f1-3c7a8512c046'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:54 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:54 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "cinder-cd0ed385-cf72-4336-919e-ad004847a576-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-cd0ed385-cf72-4336-919e-ad004847a576-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "cinder-quobyte-cd0ed385-cf72-4336-919e-ad004847a576" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-quobyte-cd0ed385-cf72-4336-919e-ad004847a576" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:55 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1346eb-364e-436b-9122-2e568293f6d5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Deleted volume successfully. Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-beb11fd2-1624-4f8a-a57e-99e568af8269 tempest-VolumesActionsTest-978552773 None] Lock "cinder-7d219b48-fd38-458a-aad8-99d34c7de6ca-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:55 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 Sep 11 23:05:55 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:55 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:55 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576 Sep 11 23:05:55 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (2228c0b7-64ed-41e0-9bab-d7a0129cb80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60020611-02c5-4e60-a696-03d987067f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60020611-02c5-4e60-a696-03d987067f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-324137475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5fad9cc-f831-425b-84e2-faecaac64b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:56Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5442a3b7-b9ef-4977-9fee-5a786c369cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5442a3b7-b9ef-4977-9fee-5a786c369cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158e5765-cd56-42a4-9e48-150a0e4dfdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158e5765-cd56-42a4-9e48-150a0e4dfdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5fad9cc-f831-425b-84e2-faecaac64b74', 'volume_name': 'volume-e5fad9cc-f831-425b-84e2-faecaac64b74', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd090d63-135b-42c0-b8b9-6008710cff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd090d63-135b-42c0-b8b9-6008710cff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f622815-7ed7-4029-84e9-553789798f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Volume e5fad9cc-f831-425b-84e2-faecaac64b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5fad9cc-f831-425b-84e2-faecaac64b74', 'volume_size': 1} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-324137475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5fad9cc-f831-425b-84e2-faecaac64b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:56Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Creating volume e5fad9cc-f831-425b-84e2-faecaac64b74 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:55 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:55 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 1073741824 Sep 11 23:05:55 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:55 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd0ed385-cf72-4336-919e-ad004847a576" returned: 0 in 0.351s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-quobyte-cd0ed385-cf72-4336-919e-ad004847a576" released by "delete_volume" :: held 0.817s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Created reservations ['8a83d09f-11f4-4225-bacd-3e21f685d1f1', 'db853720-8b6b-4af5-a570-7864c77607e7', '31b4363a-fd3b-43ba-8800-e78da12c9692', '052b1b09-9a45-43f0-8494-759cd1fce41a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:56 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:56 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "cinder-1efcc227-63a9-4c50-98b2-4b13d9657ff4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-1efcc227-63a9-4c50-98b2-4b13d9657ff4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "cinder-quobyte-1efcc227-63a9-4c50-98b2-4b13d9657ff4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-quobyte-1efcc227-63a9-4c50-98b2-4b13d9657ff4" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[24401ed4-2083-4be7-b79f-9c5f9f082518]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:56 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 1073741824" returned: 0 in 0.602s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:56 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 Sep 11 23:05:56 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:56 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.384s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:56 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 Sep 11 23:05:56 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Deleted volume successfully. Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0929c602-9d09-4eae-8701-db8aa85d8394 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-cd0ed385-cf72-4336-919e-ad004847a576-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:56 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74" returned: 0 in 0.304s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:56 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f622815-7ed7-4029-84e9-553789798f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5fad9cc-f831-425b-84e2-faecaac64b74', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdea90f-a2de-4f4c-9cd0-dedc0eec9d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:56 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4 Sep 11 23:05:56 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Volume volume-e5fad9cc-f831-425b-84e2-faecaac64b74 (e5fad9cc-f831-425b-84e2-faecaac64b74): created successfully Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdea90f-a2de-4f4c-9cd0-dedc0eec9d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (2228c0b7-64ed-41e0-9bab-d7a0129cb80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d2cb928c-297b-451f-b543-75588ffb2d9d tempest-VolumesActionsTest-2099203051 None] Created volume successfully. Sep 11 23:05:57 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1efcc227-63a9-4c50-98b2-4b13d9657ff4" returned: 0 in 0.283s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-quobyte-1efcc227-63a9-4c50-98b2-4b13d9657ff4" released by "delete_volume" :: held 0.799s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Created reservations ['956fe113-e9db-4d89-92e4-27cce03e9416', '1ce0714c-78aa-416a-b88d-7480383d0cf2', '39708033-a4f3-47b7-bc2d-c968c9b21ca8', '94aecd14-c6de-48d7-b5a1-14bd5b4c4a4e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:57 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:57 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:57 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.257s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Deleted volume successfully. Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0ef763c7-d71d-4bec-8a7a-a3a0b28cc4d4 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-1efcc227-63a9-4c50-98b2-4b13d9657ff4-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "cinder-ef777517-6676-49e5-8801-b113eff41f13-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-ef777517-6676-49e5-8801-b113eff41f13-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "cinder-quobyte-ef777517-6676-49e5-8801-b113eff41f13" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-quobyte-ef777517-6676-49e5-8801-b113eff41f13" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e05b47-501e-4d88-8997-b61287839def]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:57 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 Sep 11 23:05:57 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-e5fad9cc-f831-425b-84e2-faecaac64b74-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Lock "cinder-e5fad9cc-f831-425b-84e2-faecaac64b74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-quobyte-e5fad9cc-f831-425b-84e2-faecaac64b74" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-e5fad9cc-f831-425b-84e2-faecaac64b74" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[06675c5d-8edc-4bb8-aff6-a5812ca5534a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:58 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13" returned: 0 in 0.539s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:58 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13 Sep 11 23:05:58 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:58 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 Sep 11 23:05:58 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Flow 'volume_create_manager' (eaeb7ebd-89d7-4827-ba57-7c0b0fd1f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e859f5-76e0-4060-b12a-553f2c0f7df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e859f5-76e0-4060-b12a-553f2c0f7df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1392346209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9ad48d-623b-40e3-abaf-0487a0fb4fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f5a9bb26c145e2b1939c6b7c72d34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:58Z,use_quota=True,user_id='aea9b0aa87c742d0bda767bae4daf5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:58 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad4cd93-6bb8-40e8-9168-a929c68abd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad4cd93-6bb8-40e8-9168-a929c68abd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b584d3-b19e-4c44-ba44-e036fd896229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b584d3-b19e-4c44-ba44-e036fd896229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9ad48d-623b-40e3-abaf-0487a0fb4fa5', 'volume_name': 'volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b209710-7c13-4c66-b598-fcd0bd2ee3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b209710-7c13-4c66-b598-fcd0bd2ee3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decf1c30-47bf-498b-abf2-af244ef70ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Volume cd9ad48d-623b-40e3-abaf-0487a0fb4fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5', 'volume_size': 1} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1392346209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9ad48d-623b-40e3-abaf-0487a0fb4fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f5a9bb26c145e2b1939c6b7c72d34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:58Z,use_quota=True,user_id='aea9b0aa87c742d0bda767bae4daf5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Creating volume cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:58 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:58 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef777517-6676-49e5-8801-b113eff41f13" returned: 0 in 0.384s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74" returned: 0 in 0.432s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:58 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 1073741824 Sep 11 23:05:58 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-quobyte-ef777517-6676-49e5-8801-b113eff41f13" released by "delete_volume" :: held 0.979s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:58 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74 Sep 11 23:05:58 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Created reservations ['345d5c95-d3fd-4b20-a921-25752057645a', '3ce23cf3-8fde-4217-aaee-f4e7d19288c5', '1a50223a-7cb8-4f1d-83b1-e859db150d5e', 'b563a1a6-19dd-4c7a-b479-f2fc91937dfc'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:58 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:58 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:58 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e5fad9cc-f831-425b-84e2-faecaac64b74" returned: 0 in 0.369s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-e5fad9cc-f831-425b-84e2-faecaac64b74" released by "delete_volume" :: held 0.856s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:59 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.342s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:59 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:59 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Deleted volume successfully. Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Created reservations ['4ae910d4-39f6-41d1-9267-c03f3250e74b', '7454b541-39e6-445a-9656-697163f9de08', '39f6754b-90bd-4667-a7f7-8a5dba62bf1c', '060f5e20-4d36-4d78-b996-73561abb0037'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4f6b0763-e99f-4efd-a1e3-4d67e1cece29 tempest-AttachVolumeTestJSON-1051598099 None] Lock "cinder-ef777517-6676-49e5-8801-b113eff41f13-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:59 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 1073741824" returned: 0 in 0.673s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:59 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:05:59 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:59 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 Sep 11 23:05:59 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:59 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:05:59 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5" returned: 0 in 0.319s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:59 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.376s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Deleted volume successfully. Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decf1c30-47bf-498b-abf2-af244ef70ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f78ea15-bc0e-4403-9661-930a5caeb971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Volume volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 (cd9ad48d-623b-40e3-abaf-0487a0fb4fa5): created successfully Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f78ea15-bc0e-4403-9661-930a5caeb971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Flow 'volume_create_manager' (eaeb7ebd-89d7-4827-ba57-7c0b0fd1f630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-055fe827-d1ea-4647-ad03-8bcdfcd72c80 tempest-VolumesActionsTest-978552773 None] Lock "cinder-e5fad9cc-f831-425b-84e2-faecaac64b74-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-68508eb6-d31a-40eb-a83c-26f9eb7203e9 tempest-AttachVolumeNegativeTest-1754580533 None] Created volume successfully. Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Flow 'volume_create_manager' (018d849c-5515-4328-b18d-11ed4a4306f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eba8b2-5faf-4a59-b857-0c32a335ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eba8b2-5faf-4a59-b857-0c32a335ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1620587853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb35ac6b-de24-4988-ac0f-5c08893166e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f656ca9b0154a85a5212854e545505d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:00Z,use_quota=True,user_id='3984b71019d34df9b412496e21005788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dffbda-f877-42bf-bb20-ef507d18ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dffbda-f877-42bf-bb20-ef507d18ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532f8081-d84a-4d1a-85fd-621c914bab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532f8081-d84a-4d1a-85fd-621c914bab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb35ac6b-de24-4988-ac0f-5c08893166e6', 'volume_name': 'volume-bb35ac6b-de24-4988-ac0f-5c08893166e6', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a79579-3277-4415-b775-19aea5746ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a79579-3277-4415-b775-19aea5746ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32b2ab-390c-4558-93a3-0b313f98442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Volume bb35ac6b-de24-4988-ac0f-5c08893166e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb35ac6b-de24-4988-ac0f-5c08893166e6', 'volume_size': 1} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1620587853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb35ac6b-de24-4988-ac0f-5c08893166e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f656ca9b0154a85a5212854e545505d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:00Z,use_quota=True,user_id='3984b71019d34df9b412496e21005788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Creating volume bb35ac6b-de24-4988-ac0f-5c08893166e6 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:00 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:00 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 1073741824 Sep 11 23:06:00 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:00 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 1073741824" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:00 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 Sep 11 23:06:00 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:00 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6" returned: 0 in 0.435s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32b2ab-390c-4558-93a3-0b313f98442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb35ac6b-de24-4988-ac0f-5c08893166e6', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330704f6-f45d-4400-96c1-587b927a9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Volume volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 (bb35ac6b-de24-4988-ac0f-5c08893166e6): created successfully Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330704f6-f45d-4400-96c1-587b927a9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Flow 'volume_create_manager' (018d849c-5515-4328-b18d-11ed4a4306f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-7dbb60f6-b82d-4950-9306-0b07678bba7d req-09ae553d-837d-4722-8205-272bb622b940 tempest-VolumesGetTestJSON-787228223 None] Created volume successfully. Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (73fb50ed-1095-4d61-9f93-e4d1f13f23e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcdfdca-3e48-4e58-b3cc-0a45bc6a7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcdfdca-3e48-4e58-b3cc-0a45bc6a7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2038478382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b1968b-2d03-4d02-aee6-1fa34c5f101f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:01Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0223cbfe-31ef-4c2d-ba1c-f4f74319f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0223cbfe-31ef-4c2d-ba1c-f4f74319f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cfd6da-bf8d-4092-b577-aff6a48d3b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cfd6da-bf8d-4092-b577-aff6a48d3b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b1968b-2d03-4d02-aee6-1fa34c5f101f', 'volume_name': 'volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d637f2ee-ec06-45c3-a472-f1f8606aa1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d637f2ee-ec06-45c3-a472-f1f8606aa1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdac6b6-4aed-4974-a624-fa65c33b891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Volume 42b1968b-2d03-4d02-aee6-1fa34c5f101f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f', 'volume_size': 1} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2038478382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b1968b-2d03-4d02-aee6-1fa34c5f101f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:01Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Creating volume 42b1968b-2d03-4d02-aee6-1fa34c5f101f {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:01 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:01 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f 1073741824 Sep 11 23:06:01 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-a832a3e0-957a-4d7c-981c-dd1bf44d7fad req-cdbd36f1-90a1-45ec-9a34-563cc35819c2 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:01 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f 1073741824" returned: 0 in 0.436s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:01 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f Sep 11 23:06:01 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:01 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f" returned: 0 in 0.265s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-a832a3e0-957a-4d7c-981c-dd1bf44d7fad req-cdbd36f1-90a1-45ec-9a34-563cc35819c2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.574s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdac6b6-4aed-4974-a624-fa65c33b891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc079f95-dcb1-4a65-a48d-4efa1982977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-a832a3e0-957a-4d7c-981c-dd1bf44d7fad req-cdbd36f1-90a1-45ec-9a34-563cc35819c2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Volume volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f (42b1968b-2d03-4d02-aee6-1fa34c5f101f): created successfully Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc079f95-dcb1-4a65-a48d-4efa1982977e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (73fb50ed-1095-4d61-9f93-e4d1f13f23e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-98a48849-a578-44a7-8941-13dc3a2ca246 tempest-VolumesActionsTest-2099203051 None] Created volume successfully. Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-a832a3e0-957a-4d7c-981c-dd1bf44d7fad req-cdbd36f1-90a1-45ec-9a34-563cc35819c2 tempest-AttachVolumeNegativeTest-1754580533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81faf680-62c0-421d-82e8-9c1356a5794e', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:06:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-a832a3e0-957a-4d7c-981c-dd1bf44d7fad req-cdbd36f1-90a1-45ec-9a34-563cc35819c2 tempest-AttachVolumeNegativeTest-1754580533 None] attachment_update completed successfully. Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Acquiring lock "cinder-bb35ac6b-de24-4988-ac0f-5c08893166e6-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Lock "cinder-bb35ac6b-de24-4988-ac0f-5c08893166e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Acquiring lock "cinder-quobyte-bb35ac6b-de24-4988-ac0f-5c08893166e6" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Lock "cinder-quobyte-bb35ac6b-de24-4988-ac0f-5c08893166e6" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3bec1c-bd98-47e6-ac48-403dcab34265]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:02 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 Sep 11 23:06:02 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:02 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6" returned: 0 in 0.529s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:03 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6 Sep 11 23:06:03 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-42b1968b-2d03-4d02-aee6-1fa34c5f101f-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Lock "cinder-42b1968b-2d03-4d02-aee6-1fa34c5f101f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Acquiring lock "cinder-quobyte-42b1968b-2d03-4d02-aee6-1fa34c5f101f" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-42b1968b-2d03-4d02-aee6-1fa34c5f101f" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da46759-d586-476b-bd9c-8bc57c820322]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:03 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb35ac6b-de24-4988-ac0f-5c08893166e6" returned: 0 in 0.486s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Lock "cinder-quobyte-bb35ac6b-de24-4988-ac0f-5c08893166e6" released by "delete_volume" :: held 1.103s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.quota [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Created reservations ['e1fb00af-4fe1-4263-901b-e99c8a377ba2', '9b952433-9a72-48cd-8f1a-5690807db6b2', '3f8e05f8-3cab-4150-89de-351dc243309c', '2fde012e-9412-49ae-84fe-c92ed5502df0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:03 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f Sep 11 23:06:03 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:03 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:03 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:03 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f" returned: 0 in 0.458s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:03 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f Sep 11 23:06:03 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:04 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.331s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.manager [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Deleted volume successfully. Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-3e2a3b64-685f-43ae-b051-a42bd6153569 req-188ce7a8-6ea3-416a-b5f1-a67acb87c5a3 tempest-VolumesGetTestJSON-787228223 None] Lock "cinder-bb35ac6b-de24-4988-ac0f-5c08893166e6-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:04 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-42b1968b-2d03-4d02-aee6-1fa34c5f101f" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Lock "cinder-quobyte-42b1968b-2d03-4d02-aee6-1fa34c5f101f" released by "delete_volume" :: held 0.885s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Created reservations ['52381b16-2a04-444d-aa53-0dafa0ada2de', 'aea6a107-ce58-4a93-8ca3-a9148c25282e', '20ad0369-2c58-4dac-baac-2d3b79de0538', 'd239f664-6098-466d-9391-e2e4ff9f2596'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-1dec59e0-02e9-4e9c-8c67-05852e93a2a7 req-938b5c2d-a9ce-435b-8800-6bd9c9ea3858 tempest-AttachVolumeNegativeTest-1754580533 None] Terminate volume connection completed successfully. Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-1dec59e0-02e9-4e9c-8c67-05852e93a2a7 req-938b5c2d-a9ce-435b-8800-6bd9c9ea3858 tempest-AttachVolumeNegativeTest-1754580533 None] Deleting attachment 81faf680-62c0-421d-82e8-9c1356a5794e. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:04 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:04 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:04 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.298s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Deleted volume successfully. Sep 11 23:06:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-be2c2d4c-c23a-4e49-be7b-3597c080224b tempest-VolumesActionsTest-978552773 None] Lock "cinder-42b1968b-2d03-4d02-aee6-1fa34c5f101f-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (74d02b2e-62af-40f1-a049-c6d15f27c18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36216578-d6e2-4aea-a1ac-70447e58f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36216578-d6e2-4aea-a1ac-70447e58f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735039553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18e3017-4e84-4d84-9d23-f6add991f19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:05Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e367c6db-6ab3-452f-b157-55fb2fdf3ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e367c6db-6ab3-452f-b157-55fb2fdf3ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56951c65-db79-480a-84a4-c5f3e27e0798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56951c65-db79-480a-84a4-c5f3e27e0798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18e3017-4e84-4d84-9d23-f6add991f19b', 'volume_name': 'volume-c18e3017-4e84-4d84-9d23-f6add991f19b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c82b5d-7e40-48c2-b231-a4cf97bccd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c82b5d-7e40-48c2-b231-a4cf97bccd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540f72dc-5744-4d86-acf2-38f21f59ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Volume c18e3017-4e84-4d84-9d23-f6add991f19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18e3017-4e84-4d84-9d23-f6add991f19b', 'volume_size': 1} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735039553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18e3017-4e84-4d84-9d23-f6add991f19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211adc07d2342b0921ae9e60499e67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:05Z,use_quota=True,user_id='bf9d59b2071440faa63a3dfdb6344899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Creating volume c18e3017-4e84-4d84-9d23-f6add991f19b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:05 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:05 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b 1073741824 Sep 11 23:06:05 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:06 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b 1073741824" returned: 0 in 0.749s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:06 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b Sep 11 23:06:06 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:06 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b" returned: 0 in 0.302s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540f72dc-5744-4d86-acf2-38f21f59ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18e3017-4e84-4d84-9d23-f6add991f19b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c4ecbd-6af1-404a-912c-3ac3dfeee0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Volume volume-c18e3017-4e84-4d84-9d23-f6add991f19b (c18e3017-4e84-4d84-9d23-f6add991f19b): created successfully Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c4ecbd-6af1-404a-912c-3ac3dfeee0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Flow 'volume_create_manager' (74d02b2e-62af-40f1-a049-c6d15f27c18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ffd0ef46-8f81-4e81-9940-8478e84e5f9e tempest-VolumesActionsTest-2099203051 None] Created volume successfully. Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Acquiring lock "cinder-c18e3017-4e84-4d84-9d23-f6add991f19b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Lock "cinder-c18e3017-4e84-4d84-9d23-f6add991f19b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Acquiring lock "cinder-quobyte-c18e3017-4e84-4d84-9d23-f6add991f19b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Lock "cinder-quobyte-c18e3017-4e84-4d84-9d23-f6add991f19b" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[019b67f4-f66b-4f8a-9932-3573b5f0bfa6]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:08 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b Sep 11 23:06:08 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:08 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b" returned: 0 in 0.417s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:08 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b Sep 11 23:06:08 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:09 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c18e3017-4e84-4d84-9d23-f6add991f19b" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Lock "cinder-quobyte-c18e3017-4e84-4d84-9d23-f6add991f19b" released by "delete_volume" :: held 0.881s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Created reservations ['24d30df4-f2aa-4d87-b585-7d1e3cabbefe', '888361fa-35ca-4ecd-bfc7-43bcec48b8a1', '7d8db99b-5ca2-4538-832e-693fe2aec26b', '6696603d-8767-4e46-994e-42753252edb7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:09 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:09 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:09 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.476s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Deleted volume successfully. Sep 11 23:06:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f0931275-fd2b-473f-9e42-928a9a4dda1d tempest-VolumesActionsTest-2099203051 None] Lock "cinder-c18e3017-4e84-4d84-9d23-f6add991f19b-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "cinder-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "cinder-quobyte-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-quobyte-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06ce38-90d3-4288-8c02-c9e34529bb91]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:10 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 Sep 11 23:06:10 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:10 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5" returned: 0 in 0.534s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:10 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5 Sep 11 23:06:10 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:11 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-quobyte-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5" released by "delete_volume" :: held 0.970s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Flow 'volume_create_manager' (5837e097-510b-4698-a17b-719f5160cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2802d25-22ac-420f-ba69-169d36f626bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2802d25-22ac-420f-ba69-169d36f626bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-721787302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdeea42-ce8a-433b-af55-789848fcd5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323972ca0524b81abd270072d5f9741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:11Z,use_quota=True,user_id='cb07c2974ab34b518a7ecd003931c01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585ee1c9-d276-44e6-9cf9-45401ff2664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585ee1c9-d276-44e6-9cf9-45401ff2664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563adb4c-ae80-4977-bdb6-f9584962b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563adb4c-ae80-4977-bdb6-f9584962b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdeea42-ce8a-433b-af55-789848fcd5f3', 'volume_name': 'volume-ebdeea42-ce8a-433b-af55-789848fcd5f3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7af28d2-a95d-4bfc-a5c3-f342f036fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7af28d2-a95d-4bfc-a5c3-f342f036fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de5a498-8d61-42b1-8990-3723f9320409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Volume ebdeea42-ce8a-433b-af55-789848fcd5f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdeea42-ce8a-433b-af55-789848fcd5f3', 'volume_size': 1} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-721787302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdeea42-ce8a-433b-af55-789848fcd5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c323972ca0524b81abd270072d5f9741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:11Z,use_quota=True,user_id='cb07c2974ab34b518a7ecd003931c01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Creating volume ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:11 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:11 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 1073741824 Sep 11 23:06:11 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Created reservations ['9f5d43e5-6180-4a38-9081-95a639fb6653', '6aac2185-61c7-4982-aa1c-2d107464e01c', '8faca4e7-231b-4f38-87c0-bc341c88774b', '7df58e11-499c-4f08-a197-1b7fd53a1136'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:11 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:11 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:11 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 1073741824" returned: 0 in 0.601s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:12 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.413s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Deleted volume successfully. Sep 11 23:06:12 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 Sep 11 23:06:12 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c92ae105-8dde-42a7-a58c-35695f90fcc2 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-cd9ad48d-623b-40e3-abaf-0487a0fb4fa5-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:12 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de5a498-8d61-42b1-8990-3723f9320409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdeea42-ce8a-433b-af55-789848fcd5f3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9982cb72-c4ed-4a00-b890-780ebf727a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Volume volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 (ebdeea42-ce8a-433b-af55-789848fcd5f3): created successfully Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9982cb72-c4ed-4a00-b890-780ebf727a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Flow 'volume_create_manager' (5837e097-510b-4698-a17b-719f5160cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-bed10ae7-a47e-45a1-a9a4-06eeed0d5f1a req-280bffa6-ccaa-4f7b-aee4-8e5bb07b0474 tempest-VolumesSnapshotsTestJSON-773182033 None] Created volume successfully. Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "cinder-06d63d8a-4e79-405d-b759-194922fe6478-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-06d63d8a-4e79-405d-b759-194922fe6478-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "cinder-quobyte-06d63d8a-4e79-405d-b759-194922fe6478" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-quobyte-06d63d8a-4e79-405d-b759-194922fe6478" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7952d8db-72b6-4423-80fc-62fd4d218946]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:12 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 Sep 11 23:06:12 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:13 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:13 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478 Sep 11 23:06:13 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:13 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-06d63d8a-4e79-405d-b759-194922fe6478" returned: 0 in 0.266s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-quobyte-06d63d8a-4e79-405d-b759-194922fe6478" released by "delete_volume" :: held 0.769s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Created reservations ['3d00ec4a-dcc1-4b21-b0cb-802cb2eff22c', '7ed1c4b0-7340-4099-92e2-17a85a6a5ab5', '948b05af-e5be-46ed-9ee4-ccc0a9c1059f', '5973aba2-8495-49bc-b101-d6c5ca4638c0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:13 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:13 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Creating offline snapshot 87cadb53-1cc5-4db9-aff2-1ade72f33bc3 of volume ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6eccb2-5712-4a52-a4f9-081de86a8aad]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:14 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.489s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "cinder-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:14 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 Sep 11 23:06:14 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Deleted volume successfully. Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c79d9375-9545-4116-aa22-ecd70694a101 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-06d63d8a-4e79-405d-b759-194922fe6478-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "cinder-quobyte-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-quobyte-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[892ddee8-3b63-4534-abdc-9bddf180f86b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:14 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c Sep 11 23:06:14 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:14 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3" returned: 0 in 0.704s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:14 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 1G Sep 11 23:06:14 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:14 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c" returned: 0 in 0.521s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:14 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c Sep 11 23:06:14 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:15 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c" returned: 0 in 0.285s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-quobyte-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c" released by "delete_volume" :: held 0.856s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:15 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 1G" returned: 0 in 0.530s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:15 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 Sep 11 23:06:15 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Created reservations ['064b5b5d-a0eb-4d55-8eb0-e57b842b1849', '5d107da2-21e4-4f3d-8619-9977b91fa6a6', '59d7f0c2-d8a4-4586-a5a6-4cbeb9ca6789', '4834c6c5-7346-4a6c-9ff4-31306202629c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:15 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:15 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:15 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3" returned: 0 in 0.413s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:15 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 is being set with open permissions: ugo+rw Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:15 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 Sep 11 23:06:15 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:15 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Deleted volume successfully. Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3e72c991-74b2-4bcb-a4a0-ab45a2cf34f3 tempest-AttachVolumeNegativeTest-1754580533 None] Lock "cinder-5d9e5cf7-5956-4c8b-b0dc-5b963b871c6c-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:15 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3" returned: 0 in 0.390s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:15 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info Sep 11 23:06:15 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:16 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:16 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info is being set with open permissions: ugo+rw Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:16 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info Sep 11 23:06:16 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:16 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.info" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:16 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-4351f70e-7bbb-4930-951a-f7255a727d15 req-46e7b966-2add-4cc7-ae76-6993a444421e tempest-VolumesSnapshotsTestJSON-773182033 None] Create snapshot completed successfully Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2ecd595a-1c41-4efe-98d7-4d134f38f365 tempest-BackendsCapabilitiesAdminTestsJSON-1649464602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88002) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2d00ece5-1544-42e6-8281-c4c2f36b31c0 tempest-BackendsCapabilitiesAdminTestsJSON-1649464602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88002) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 23:06:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "cinder-87cadb53-1cc5-4db9-aff2-1ade72f33bc3-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-87cadb53-1cc5-4db9-aff2-1ade72f33bc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "cinder-quobyte-ebdeea42-ce8a-433b-af55-789848fcd5f3" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-quobyte-ebdeea42-ce8a-433b-af55-789848fcd5f3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "cinder-quobyte-87cadb53-1cc5-4db9-aff2-1ade72f33bc3" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-quobyte-87cadb53-1cc5-4db9-aff2-1ade72f33bc3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Deleting offline snapshot 87cadb53-1cc5-4db9-aff2-1ade72f33bc3 of volume ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] snapshot_file for this snap is: volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86df553-f98d-4289-a7ba-ac5dad8fba99]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:17 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 Sep 11 23:06:17 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:17 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3" returned: 0 in 0.443s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdeea42-ce8a-433b-af55-789848fcd5f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b17ed5-0e6a-4bdf-83b0-3f4dff61f6c2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:17 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 Sep 11 23:06:17 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:18 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3" returned: 0 in 0.533s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:18 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 Sep 11 23:06:18 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:18 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:18 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3 Sep 11 23:06:18 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:18 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3.87cadb53-1cc5-4db9-aff2-1ade72f33bc3" returned: 0 in 0.307s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-quobyte-87cadb53-1cc5-4db9-aff2-1ade72f33bc3" released by "_delete_snapshot" :: held 1.858s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-quobyte-ebdeea42-ce8a-433b-af55-789848fcd5f3" released by "delete_snapshot" :: held 1.894s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG cinder.quota [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Created reservations ['d3e88865-dd63-4231-aae9-287e22ec4a54', 'e5e4362d-3ee6-415c-bb92-121459c7385f', '4ddbe2a4-eac5-47ab-931f-c25a042a8b59', 'a85c86c6-ff77-4b75-8d2e-87a6936c825e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Delete snapshot completed successfully. Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-29f9535c-2d50-4c02-845f-358c211f8dc5 req-94e47086-e729-4c7b-ae49-020ae4454b4a tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-87cadb53-1cc5-4db9-aff2-1ade72f33bc3-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "cinder-ebdeea42-ce8a-433b-af55-789848fcd5f3-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-ebdeea42-ce8a-433b-af55-789848fcd5f3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "cinder-quobyte-ebdeea42-ce8a-433b-af55-789848fcd5f3" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-quobyte-ebdeea42-ce8a-433b-af55-789848fcd5f3" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf0cf6-c5b1-4210-b570-961ea3447103]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:19 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 Sep 11 23:06:19 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:19 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3" returned: 0 in 0.447s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:19 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3 Sep 11 23:06:19 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:20 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebdeea42-ce8a-433b-af55-789848fcd5f3" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-quobyte-ebdeea42-ce8a-433b-af55-789848fcd5f3" released by "delete_volume" :: held 0.848s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG cinder.quota [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Created reservations ['e66ec1fe-8604-4b90-a817-e729b9a2394f', 'b4b9a4a5-6c20-4171-89a0-53008a5509a7', '298e09c4-edb2-447b-bab7-7afae5674e2c', 'c9b6fc9a-0ace-4283-8670-9797db4ed871'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:20 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:20 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:20 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.273s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG cinder.manager [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:20 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Deleted volume successfully. Sep 11 23:06:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-5e68dc86-ed3b-4617-887a-8ef43ba2cda8 req-2b4dc8a7-3c33-4585-a531-d70a4a9ef26c tempest-VolumesSnapshotsTestJSON-773182033 None] Lock "cinder-ebdeea42-ce8a-433b-af55-789848fcd5f3-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:29 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=167,cinder:SELECT=134,cinder:INSERT=40,cinder:DELETE=17 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:06:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-46854972-8f73-40c4-89db-c51ed1b209ea tempest-GroupSnapshotsV319Test-1452452997 None] Group tempest-GroupSnapshotsV319Test-Group-1840865087: creating Sep 11 23:06:29 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=144,cinder:INSERT=39,cinder:UPDATE=175,cinder:DELETE=11 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:06:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-46854972-8f73-40c4-89db-c51ed1b209ea tempest-GroupSnapshotsV319Test-1452452997 None] Group tempest-GroupSnapshotsV319Test-Group-1840865087: created successfully Sep 11 23:06:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-46854972-8f73-40c4-89db-c51ed1b209ea tempest-GroupSnapshotsV319Test-1452452997 None] Create group completed successfully. Sep 11 23:06:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0276f165-0cd2-41cc-969c-ed5fed03e499 tempest-GroupSnapshotsTest-1064308120 None] Group tempest-GroupSnapshotsTest-Group-656942999: creating Sep 11 23:06:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0276f165-0cd2-41cc-969c-ed5fed03e499 tempest-GroupSnapshotsTest-1064308120 None] Group tempest-GroupSnapshotsTest-Group-656942999: created successfully Sep 11 23:06:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0276f165-0cd2-41cc-969c-ed5fed03e499 tempest-GroupSnapshotsTest-1064308120 None] Create group completed successfully. Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Flow 'volume_create_manager' (6f168d30-5a6c-47db-8eee-a9e15232f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f763b7-489b-4f97-9baa-3ac71e7b60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f763b7-489b-4f97-9baa-3ac71e7b60f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-576623947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=383cc79c-0858-455f-a037-1cf277b96813,host='devstack@QuobyteHD#QuobyteHD',id=875af0d3-f473-4f62-82fc-c1c43b228352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df04deb038fd4de3acb08e83bede0052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:31Z,use_quota=True,user_id='c2ae20bda3c443b2863f840b762e3ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a9d9d30-37bd-4a1b-a2dd-bd315a28423c),volume_type_id=5a9d9d30-37bd-4a1b-a2dd-bd315a28423c)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc72322c-ebd3-42ec-a49d-15ae6469a902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc72322c-ebd3-42ec-a49d-15ae6469a902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54b7e70-be89-4096-8a01-ca5070cf2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54b7e70-be89-4096-8a01-ca5070cf2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875af0d3-f473-4f62-82fc-c1c43b228352', 'volume_name': 'volume-875af0d3-f473-4f62-82fc-c1c43b228352', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f0218-f50b-4ab5-85b1-88b1983ad779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f0218-f50b-4ab5-85b1-88b1983ad779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c8ac51-a09f-4a4e-b012-d0790c4e46d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Volume 875af0d3-f473-4f62-82fc-c1c43b228352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875af0d3-f473-4f62-82fc-c1c43b228352', 'volume_size': 1} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=383cc79c-0858-455f-a037-1cf277b96813,created_at=2026-09-11T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-576623947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=383cc79c-0858-455f-a037-1cf277b96813,host='devstack@QuobyteHD#QuobyteHD',id=875af0d3-f473-4f62-82fc-c1c43b228352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df04deb038fd4de3acb08e83bede0052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:31Z,use_quota=True,user_id='c2ae20bda3c443b2863f840b762e3ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a9d9d30-37bd-4a1b-a2dd-bd315a28423c),volume_type_id=5a9d9d30-37bd-4a1b-a2dd-bd315a28423c)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Creating volume 875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:31 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:31 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 1073741824 Sep 11 23:06:31 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (8005d90b-7e76-4221-a786-77b2fd033f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf2b473-fac2-4c75-b77f-503c26cfa8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf2b473-fac2-4c75-b77f-503c26cfa8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304206349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0848d18f-7d2a-4aa9-9cc0-afc9395b153f,host='devstack@QuobyteHD#QuobyteHD',id=98547210-efb1-4b32-8955-bd6076c370da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:32Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4829ef22-b84c-4331-83d2-63ecd578c008),volume_type_id=4829ef22-b84c-4331-83d2-63ecd578c008)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d1f24-839d-423a-bc1b-2d65efb39086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d1f24-839d-423a-bc1b-2d65efb39086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2816699a-ce4f-4108-bde9-38f62a59319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2816699a-ce4f-4108-bde9-38f62a59319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98547210-efb1-4b32-8955-bd6076c370da', 'volume_name': 'volume-98547210-efb1-4b32-8955-bd6076c370da', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e707909-680f-453f-a74e-88e78d930701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e707909-680f-453f-a74e-88e78d930701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb23f0f-3550-4af7-8584-be1dd3e35dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Volume 98547210-efb1-4b32-8955-bd6076c370da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98547210-efb1-4b32-8955-bd6076c370da', 'volume_size': 1} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:31 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 1073741824" returned: 0 in 0.583s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:31 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 Sep 11 23:06:31 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:32 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352" returned: 0 in 0.269s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0848d18f-7d2a-4aa9-9cc0-afc9395b153f,created_at=2026-09-11T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304206349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0848d18f-7d2a-4aa9-9cc0-afc9395b153f,host='devstack@QuobyteHD#QuobyteHD',id=98547210-efb1-4b32-8955-bd6076c370da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:32Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4829ef22-b84c-4331-83d2-63ecd578c008),volume_type_id=4829ef22-b84c-4331-83d2-63ecd578c008)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Creating volume 98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:32 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c8ac51-a09f-4a4e-b012-d0790c4e46d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875af0d3-f473-4f62-82fc-c1c43b228352', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:32 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da 1073741824 Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15796657-582a-4e85-b24d-5f5d3fe0dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:32 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:32 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Volume volume-875af0d3-f473-4f62-82fc-c1c43b228352 (875af0d3-f473-4f62-82fc-c1c43b228352): created successfully Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15796657-582a-4e85-b24d-5f5d3fe0dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Flow 'volume_create_manager' (6f168d30-5a6c-47db-8eee-a9e15232f038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ad7e684a-110f-4c11-83e4-b8d74f1717cc tempest-GroupSnapshotsV319Test-1452452997 None] Created volume successfully. Sep 11 23:06:32 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da 1073741824" returned: 0 in 0.548s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:32 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da Sep 11 23:06:32 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:33 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb23f0f-3550-4af7-8584-be1dd3e35dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98547210-efb1-4b32-8955-bd6076c370da', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab82152-5f2d-4d21-b4fa-68b6dd6782be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:33 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Volume volume-98547210-efb1-4b32-8955-bd6076c370da (98547210-efb1-4b32-8955-bd6076c370da): created successfully Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab82152-5f2d-4d21-b4fa-68b6dd6782be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (8005d90b-7e76-4221-a786-77b2fd033f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b659b051-50ce-4650-a236-ad9457386092 tempest-GroupSnapshotsTest-1064308120 None] Created volume successfully. Sep 11 23:06:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] GroupSnapshot 2bcdc893-9cd7-44a3-9aaf-fbc694561215: creating. Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Group snapshot 2bcdc893-9cd7-44a3-9aaf-fbc694561215: creating. {{(pid=88002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Creating offline snapshot c5c7cc83-f86d-46ed-adfe-1b19ad804270 of volume 875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[012d6081-9745-4e06-9f8f-4265bfb8be6c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:34 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 Sep 11 23:06:34 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] GroupSnapshot dfe43604-fceb-4498-914e-19eaf4fdd590: creating. Sep 11 23:06:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Group snapshot dfe43604-fceb-4498-914e-19eaf4fdd590: creating. {{(pid=88002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:06:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:34 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352" returned: 0 in 0.585s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:34 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 1G Sep 11 23:06:34 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:34 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 1G" returned: 0 in 0.490s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875af0d3-f473-4f62-82fc-c1c43b228352 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:35 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875af0d3-f473-4f62-82fc-c1c43b228352 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 Sep 11 23:06:35 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:35 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875af0d3-f473-4f62-82fc-c1c43b228352 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270" returned: 0 in 0.307s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:35 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:35 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 Sep 11 23:06:35 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:35 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270" returned: 0 in 0.256s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:35 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info Sep 11 23:06:35 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:35 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info" returned: 0 in 0.266s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:35 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:06:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:35 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info Sep 11 23:06:35 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:36 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.info" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.773s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Creating offline snapshot 36605e92-dff2-427b-bed4-339b70f2aa38 of volume 98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[46add254-a79e-4e96-ba20-023844fadf9c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-374341b5-1966-4cc5-bb39-756b9e848dc3 tempest-GroupSnapshotsV319Test-1452452997 None] group_snapshot 2bcdc893-9cd7-44a3-9aaf-fbc694561215: created successfully Sep 11 23:06:36 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da Sep 11 23:06:36 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:36 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da" returned: 0 in 0.444s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:36 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 1G Sep 11 23:06:36 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:37 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 1G" returned: 0 in 0.514s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98547210-efb1-4b32-8955-bd6076c370da -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:37 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98547210-efb1-4b32-8955-bd6076c370da -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 Sep 11 23:06:37 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:37 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98547210-efb1-4b32-8955-bd6076c370da -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38" returned: 0 in 0.365s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:37 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] group_snapshot 2bcdc893-9cd7-44a3-9aaf-fbc694561215: deleting Sep 11 23:06:37 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 Sep 11 23:06:37 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] group_snapshot 2bcdc893-9cd7-44a3-9aaf-fbc694561215: deleting {{(pid=88002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "cinder-quobyte-875af0d3-f473-4f62-82fc-c1c43b228352" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Lock "cinder-quobyte-875af0d3-f473-4f62-82fc-c1c43b228352" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "cinder-quobyte-c5c7cc83-f86d-46ed-adfe-1b19ad804270" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Lock "cinder-quobyte-c5c7cc83-f86d-46ed-adfe-1b19ad804270" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Deleting offline snapshot c5c7cc83-f86d-46ed-adfe-1b19ad804270 of volume 875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] snapshot_file for this snap is: volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ce89f8-5307-49d8-8f73-d112b5ec3575]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:37 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38" returned: 0 in 0.346s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:37 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 Sep 11 23:06:37 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:37 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info Sep 11 23:06:37 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:38 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info" returned: 0 in 0.353s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:38 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:38 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info Sep 11 23:06:38 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:38 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270" returned: 0 in 0.640s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875af0d3-f473-4f62-82fc-c1c43b228352(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb085a-ee15-484c-8d36-3e9272a3c9c9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:38 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.info" returned: 0 in 0.298s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:38 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 Sep 11 23:06:38 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4718b480-ee9f-4e70-a7bd-ae61a7fa3d83 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot dfe43604-fceb-4498-914e-19eaf4fdd590: created successfully Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Flow 'volume_create_manager' (8189caab-ea9a-4a14-99e9-664a714373b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f343cf-50c4-469d-990e-3b70e3e38f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f343cf-50c4-469d-990e-3b70e3e38f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-890023232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f628e7a-56d9-4174-8de1-f254370e6ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214fc0b5a9724ddcae6d57bdf8d9ef5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:39Z,use_quota=True,user_id='a799bbf8a9db4f12b4070734f41c3b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22553cb-88b9-4a77-887e-c002c99adb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22553cb-88b9-4a77-887e-c002c99adb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70a83e1-bf4f-4b19-859c-0f81109bb000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:06:38 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352" returned: 0 in 0.511s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:38 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 Sep 11 23:06:38 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:39 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:39 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270 Sep 11 23:06:39 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70a83e1-bf4f-4b19-859c-0f81109bb000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f628e7a-56d9-4174-8de1-f254370e6ab2', 'volume_name': 'volume-2f628e7a-56d9-4174-8de1-f254370e6ab2', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e856f8a-d1bc-4a85-bb2f-fb547aa3ffb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e856f8a-d1bc-4a85-bb2f-fb547aa3ffb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cce821e-1070-489d-8f43-b8b93cc14944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Volume 2f628e7a-56d9-4174-8de1-f254370e6ab2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f628e7a-56d9-4174-8de1-f254370e6ab2', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Trying to clone 2f628e7a-56d9-4174-8de1-f254370e6ab2 from image 1baacf90-ac97-495c-951c-132c1ebb83be at location (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-36605e92-dff2-427b-bed4-339b70f2aa38-e1adc612-b67e-499f-84dd-85f0bb442d30" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-36605e92-dff2-427b-bed4-339b70f2aa38-e1adc612-b67e-499f-84dd-85f0bb442d30" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Creating volume e1adc612-b67e-499f-84dd-85f0bb442d30 from snapshot 36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-e1adc612-b67e-499f-84dd-85f0bb442d30" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:39 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352.c5c7cc83-f86d-46ed-adfe-1b19ad804270" returned: 0 in 0.457s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-e1adc612-b67e-499f-84dd-85f0bb442d30" acquired by "_copy_volume_from_snapshot" :: waited 0.086s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] snapshot: 36605e92-dff2-427b-bed4-339b70f2aa38, volume: e1adc612-b67e-499f-84dd-85f0bb442d30, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Lock "cinder-quobyte-c5c7cc83-f86d-46ed-adfe-1b19ad804270" released by "_delete_snapshot" :: held 2.222s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Lock "cinder-quobyte-875af0d3-f473-4f62-82fc-c1c43b228352" released by "delete_snapshot" :: held 2.314s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65874ea-627d-4107-8329-32f7b8e4e648]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:40 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 Sep 11 23:06:40 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:06:40 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:06:40 devstack cinder-volume[88002]: WARNING cinder.quota [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2005257406 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2005257406, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:06:40 devstack cinder-volume[88002]: WARNING cinder.quota [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2005257406 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2005257406, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] Created reservations ['40856032-269d-435f-91bb-a3897324ad00', 'c7177dad-fce3-4d44-bdf5-ab8d6b015ad0', 'fa682823-e39a-428a-b5bb-2d0c30ac9ea8', '82c7966c-9f0b-4fdb-a27e-b472e4091a37'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d2599b-d893-412a-bc30-d6d033b2fbd3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:40 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0f67cf83-7aa5-47c8-9b10-adbf06cc4ff1 tempest-GroupSnapshotsV319Test-1452452997 None] group_snapshot 2bcdc893-9cd7-44a3-9aaf-fbc694561215: deleted successfully Sep 11 23:06:40 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD Sep 11 23:06:40 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:40 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38" returned: 0 in 0.472s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98547210-efb1-4b32-8955-bd6076c370da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a8a106-f615-4987-a35c-349a07c66c2c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:40 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da Sep 11 23:06:40 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:40 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be is fetched for user a799bbf8a9db4f12b4070734f41c3b71. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90b2993-c5af-460e-8447-8f04116f158c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:40 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD Sep 11 23:06:40 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:40 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da" returned: 0 in 0.405s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:06:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:40 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 Sep 11 23:06:40 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:41 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "cinder-quobyte-875af0d3-f473-4f62-82fc-c1c43b228352" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "cinder-quobyte-875af0d3-f473-4f62-82fc-c1c43b228352" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:41 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95f32da-8e0f-4812-a5ec-e35f2918ea71]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:42 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 Sep 11 23:06:42 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:42 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352" returned: 0 in 1.083s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:42 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352 Sep 11 23:06:42 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:43 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-875af0d3-f473-4f62-82fc-c1c43b228352" returned: 0 in 0.449s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "cinder-quobyte-875af0d3-f473-4f62-82fc-c1c43b228352" released by "delete_volume" :: held 1.647s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Created reservations ['3967d97b-0ad9-4c47-99f4-f3ea909f0a07'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:43 devstack cinder-volume[88002]: WARNING cinder.quota [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2005257406 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2005257406, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Created reservations ['0eecc203-c88f-4fe5-ba4b-92e8338ff1a4', '8aed373e-e1e6-4c92-a6c3-cd3134c0f7ff', 'b8c24c7f-b5cb-4867-8c0a-adb03e86e791', 'adcd8ebd-c712-43f8-a90e-021f83071f27'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:43 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:43 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:44 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.559s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:44 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cdd66244-e689-4595-830d-859a92609edc tempest-GroupSnapshotsV319Test-1452452997 None] Delete group completed successfully. Sep 11 23:06:46 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30" returned: 0 in 5.838s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:46 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:06:46 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Converted 1024.00 MB image at 175.37 MB/s Sep 11 23:06:46 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:06:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:46 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 Sep 11 23:06:46 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:47 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-e1adc612-b67e-499f-84dd-85f0bb442d30" released by "_copy_volume_from_snapshot" :: held 7.223s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-36605e92-dff2-427b-bed4-339b70f2aa38-e1adc612-b67e-499f-84dd-85f0bb442d30" released by "_create_volume_from_snapshot" :: held 7.382s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.409s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.953s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-890023232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f628e7a-56d9-4174-8de1-f254370e6ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214fc0b5a9724ddcae6d57bdf8d9ef5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:39Z,use_quota=True,user_id='a799bbf8a9db4f12b4070734f41c3b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Creating volume 2f628e7a-56d9-4174-8de1-f254370e6ab2 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:47 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:47 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 1073741824 Sep 11 23:06:47 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f1aff94f-17ad-4cce-88b3-f51b4ab2de58 tempest-GroupSnapshotsTest-1064308120 None] Create group from source-snapshot-dfe43604-fceb-4498-914e-19eaf4fdd590 completed successfully. Sep 11 23:06:47 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 1073741824" returned: 0 in 0.590s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:47 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 Sep 11 23:06:47 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-e1adc612-b67e-499f-84dd-85f0bb442d30" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-e1adc612-b67e-499f-84dd-85f0bb442d30" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd763151-49fd-4f37-8113-e90c4ce08d5b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:48 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 Sep 11 23:06:48 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:48 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Attempting download of 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 2f628e7a-56d9-4174-8de1-f254370e6ab2. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95b330-f9c6-4dff-8eba-0a24d8017694]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:48 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30" returned: 0 in 0.489s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:48 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30 Sep 11 23:06:48 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:48 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq Sep 11 23:06:48 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:48 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e1adc612-b67e-499f-84dd-85f0bb442d30" returned: 0 in 0.311s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:48 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-e1adc612-b67e-499f-84dd-85f0bb442d30" released by "delete_volume" :: held 0.885s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['df1663d6-70a5-47ef-af8b-cf9c3bd661c6'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:48 devstack cinder-volume[88002]: WARNING cinder.quota [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-209619308 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-209619308, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:06:48 devstack cinder-volume[88002]: WARNING cinder.quota [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-209619308 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-209619308, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:06:48 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq Sep 11 23:06:48 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:48 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['b993bfbe-d1bd-4190-99b8-5ed63aae5837', 'ad3731c7-a73d-4f0c-83cd-d3f9a95c4b4f', '85a4aa1f-13eb-4235-ac54-13d0475fee66', '51173555-af81-474c-b771-5b94a0f05044'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:49 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:49 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:49 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq" returned: 1 in 0.478s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_zak506fq' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4490f7-5bfb-4b0b-bfac-273005196598]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] group_snapshot dfe43604-fceb-4498-914e-19eaf4fdd590: deleting Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] group_snapshot dfe43604-fceb-4498-914e-19eaf4fdd590: deleting {{(pid=88002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-98547210-efb1-4b32-8955-bd6076c370da" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:49 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD Sep 11 23:06:49 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-98547210-efb1-4b32-8955-bd6076c370da" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-36605e92-dff2-427b-bed4-339b70f2aa38" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-36605e92-dff2-427b-bed4-339b70f2aa38" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Deleting offline snapshot 36605e92-dff2-427b-bed4-339b70f2aa38 of volume 98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:06:49 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] snapshot_file for this snap is: volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.447s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25d576-150d-47e6-88d6-810dd560b980]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fbb384c3-acce-4e23-9ebd-b1f8249e8da3 tempest-GroupSnapshotsTest-1064308120 None] Delete group completed successfully. Sep 11 23:06:49 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] 1baacf90-ac97-495c-951c-132c1ebb83be was qcow2, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:06:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:49 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 Sep 11 23:06:49 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:49 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 Sep 11 23:06:49 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:50 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38" returned: 0 in 0.524s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98547210-efb1-4b32-8955-bd6076c370da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5689fc-6179-478e-a513-689e718ed8f7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:50 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da Sep 11 23:06:50 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Flow 'volume_create_manager' (9bf63af3-2922-4531-8af5-a331db284dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7de645-9501-49ac-85b6-458e63702951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7de645-9501-49ac-85b6-458e63702951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-317287841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d323954-6d64-4245-b371-df102fc7f6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96a19dbcfba42a3a608847f092212f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:50Z,use_quota=True,user_id='3dbe660f627649e8b51dcec477b8fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd2c4f6-4e40-4edc-8671-5f4084eda5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd2c4f6-4e40-4edc-8671-5f4084eda5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4164e3a5-5998-4179-a5c4-89014793de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4164e3a5-5998-4179-a5c4-89014793de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d323954-6d64-4245-b371-df102fc7f6a4', 'volume_name': 'volume-8d323954-6d64-4245-b371-df102fc7f6a4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d6b802-34bc-4a27-a967-0c1141dca8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d6b802-34bc-4a27-a967-0c1141dca8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e79618f-c498-43db-a756-da5f050374de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:50 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Volume 8d323954-6d64-4245-b371-df102fc7f6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d323954-6d64-4245-b371-df102fc7f6a4', 'volume_size': 1} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-317287841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d323954-6d64-4245-b371-df102fc7f6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96a19dbcfba42a3a608847f092212f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:50Z,use_quota=True,user_id='3dbe660f627649e8b51dcec477b8fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Creating volume 8d323954-6d64-4245-b371-df102fc7f6a4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:50 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:50 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 1073741824 Sep 11 23:06:50 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:50 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da" returned: 0 in 0.799s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:50 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 Sep 11 23:06:50 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:51 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 1073741824" returned: 0 in 0.567s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:51 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 Sep 11 23:06:51 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:51 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38" returned: 0 in 0.438s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:51 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38 Sep 11 23:06:51 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:51 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4" returned: 0 in 0.365s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e79618f-c498-43db-a756-da5f050374de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d323954-6d64-4245-b371-df102fc7f6a4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0517d6-6567-4895-a8de-379f90683b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:51 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da.36605e92-dff2-427b-bed4-339b70f2aa38" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-36605e92-dff2-427b-bed4-339b70f2aa38" released by "_delete_snapshot" :: held 2.228s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Volume volume-8d323954-6d64-4245-b371-df102fc7f6a4 (8d323954-6d64-4245-b371-df102fc7f6a4): created successfully Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0517d6-6567-4895-a8de-379f90683b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Flow 'volume_create_manager' (9bf63af3-2922-4531-8af5-a331db284dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-98547210-efb1-4b32-8955-bd6076c370da" released by "delete_snapshot" :: held 2.280s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e3799eae-d232-4a16-b76e-14ebdb340c71 tempest-VolumeQuotasAdminTestJSON-893367650 None] Created volume successfully. Sep 11 23:06:51 devstack cinder-volume[88002]: WARNING cinder.quota [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-209619308 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-209619308, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['c366ad24-167f-4505-bd2e-171b639a1c46', 'b4415db2-b89b-41b2-93eb-aeddefd32564', '416a16cf-943d-4285-a505-a47daa2ef9dd', 'e3a07e4f-a4db-4694-8e27-8db454045578'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:51 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2" returned: 0 in 2.183s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_bzd1l3w0devstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:06:51 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Converted 112.00 MB image at 51.28 MB/s Sep 11 23:06:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-96b50fd7-ef0f-481e-9a79-e5f865e45fbb tempest-GroupSnapshotsTest-1064308120 None] group_snapshot dfe43604-fceb-4498-914e-19eaf4fdd590: deleted successfully Sep 11 23:06:51 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 1G Sep 11 23:06:51 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:52 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 1G" returned: 0 in 0.319s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Downloaded image 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 2f628e7a-56d9-4174-8de1-f254370e6ab2 successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be for user a799bbf8a9db4f12b4070734f41c3b71 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Marking volume 2f628e7a-56d9-4174-8de1-f254370e6ab2 as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Copying metadata from image 1baacf90-ac97-495c-951c-132c1ebb83be to 2f628e7a-56d9-4174-8de1-f254370e6ab2. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Creating volume glance metadata for volume 2f628e7a-56d9-4174-8de1-f254370e6ab2 backed by image 1baacf90-ac97-495c-951c-132c1ebb83be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cce821e-1070-489d-8f43-b8b93cc14944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f628e7a-56d9-4174-8de1-f254370e6ab2', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8597ab6b-aeb1-431b-8d74-18c92b05a3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Volume volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 (2f628e7a-56d9-4174-8de1-f254370e6ab2): created successfully Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8597ab6b-aeb1-431b-8d74-18c92b05a3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Flow 'volume_create_manager' (8189caab-ea9a-4a14-99e9-664a714373b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-df1d8740-9367-4c0c-ae83-d761e4c7b964 tempest-VolumesImageMetadata-634023541 None] Created volume successfully. Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "cinder-8d323954-6d64-4245-b371-df102fc7f6a4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "cinder-8d323954-6d64-4245-b371-df102fc7f6a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "cinder-quobyte-8d323954-6d64-4245-b371-df102fc7f6a4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "cinder-quobyte-8d323954-6d64-4245-b371-df102fc7f6a4" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bbd111-8141-4e79-b0f2-3b852f1431bc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:52 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 Sep 11 23:06:52 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-98547210-efb1-4b32-8955-bd6076c370da" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-98547210-efb1-4b32-8955-bd6076c370da" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b0160c-96bd-41ba-a1ac-9e7ef611ea27]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Acquiring lock "cinder-2f628e7a-56d9-4174-8de1-f254370e6ab2-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Lock "cinder-2f628e7a-56d9-4174-8de1-f254370e6ab2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:53 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4" returned: 0 in 0.494s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Acquiring lock "cinder-quobyte-2f628e7a-56d9-4174-8de1-f254370e6ab2" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:53 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4 Sep 11 23:06:53 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da Sep 11 23:06:53 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Lock "cinder-quobyte-2f628e7a-56d9-4174-8de1-f254370e6ab2" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b180b34-21a7-4032-b990-56b76a81e9c5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 Sep 11 23:06:53 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8d323954-6d64-4245-b371-df102fc7f6a4" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da" returned: 0 in 0.451s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "cinder-quobyte-8d323954-6d64-4245-b371-df102fc7f6a4" released by "delete_volume" :: held 0.911s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:53 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da Sep 11 23:06:53 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Created reservations ['24016914-27a4-4667-b2ca-0ae8cd0faa98', 'f380f328-70f5-4148-8911-ba26973fbe0f', '8630c35e-7864-4375-a7aa-8ac62b6d2b7d', '9f6409b3-23eb-4e63-946b-efcae5ca3a6d'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:53 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2" returned: 0 in 0.565s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-98547210-efb1-4b32-8955-bd6076c370da" returned: 0 in 0.323s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2 Sep 11 23:06:54 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d1ca373f-09f3-4fa8-be15-c9b085731f2a tempest-GroupsTest-1332969015 None] Group tempest-Group1-2139726495: creating Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-98547210-efb1-4b32-8955-bd6076c370da" released by "delete_volume" :: held 0.854s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d1ca373f-09f3-4fa8-be15-c9b085731f2a tempest-GroupsTest-1332969015 None] Group tempest-Group1-2139726495: created successfully Sep 11 23:06:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d1ca373f-09f3-4fa8-be15-c9b085731f2a tempest-GroupsTest-1332969015 None] Create group completed successfully. Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['447b7fe9-d8bd-4039-a5d1-6bec3ee7d51b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:54 devstack cinder-volume[88002]: WARNING cinder.db.api [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-209619308'] Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['72e0cd1a-0493-488a-b78e-50b64340956c', 'df3a38ac-1a74-4e09-ae7b-6ebff1980de2', 'b3737370-16a9-43df-b127-b9c6764d510c', 'd65e6a6a-3e2a-4b4a-8361-598b56209361'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:54 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.294s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Deleted volume successfully. Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2009262e-a7a8-499c-9678-9da5a3b8d78b tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "cinder-8d323954-6d64-4245-b371-df102fc7f6a4-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:54 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f628e7a-56d9-4174-8de1-f254370e6ab2" returned: 0 in 0.289s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Lock "cinder-quobyte-2f628e7a-56d9-4174-8de1-f254370e6ab2" released by "delete_volume" :: held 0.914s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Created reservations ['dee5e6e5-dd13-4864-9bc6-8d608f3d73a6', 'e09af410-b194-4c6c-bd60-983fb6cf4a15', '4dd87430-5750-46c6-bb22-9f1fa224a6b0', '52cb5321-7372-4e6a-b126-72cff0b2f959'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:54 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:54 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:54 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.245s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-db81207d-16fc-453d-9c85-a0746c6eef02 tempest-GroupSnapshotsTest-1064308120 None] Delete group completed successfully. Sep 11 23:06:54 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.269s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Deleted volume successfully. Sep 11 23:06:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a593bd0f-b92b-47e0-9a59-4a12a193b1a6 tempest-VolumesImageMetadata-634023541 None] Lock "cinder-2f628e7a-56d9-4174-8de1-f254370e6ab2-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-64cad8d2-4430-4f74-85f6-5c599e0d3695 tempest-GroupSnapshotsTest-1064308120 None] Group tempest-GroupSnapshotsTest-Group-656334161: creating Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-64cad8d2-4430-4f74-85f6-5c599e0d3695 tempest-GroupSnapshotsTest-1064308120 None] Group tempest-GroupSnapshotsTest-Group-656334161: created successfully Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-64cad8d2-4430-4f74-85f6-5c599e0d3695 tempest-GroupSnapshotsTest-1064308120 None] Create group completed successfully. Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bd3a30d5-b6f7-45e8-8698-4cb252b28036 tempest-GroupsTest-1332969015 None] Group tempest-Group2-736325873: creating Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bd3a30d5-b6f7-45e8-8698-4cb252b28036 tempest-GroupsTest-1332969015 None] Group tempest-Group2-736325873: created successfully Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bd3a30d5-b6f7-45e8-8698-4cb252b28036 tempest-GroupsTest-1332969015 None] Create group completed successfully. Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Flow 'volume_create_manager' (e8ab125a-1ea7-46d9-b593-dbb1456c6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870a3b7d-2050-4e4f-8605-ef1486b6622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870a3b7d-2050-4e4f-8605-ef1486b6622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-411778730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c18f0f-507f-4a65-a043-92225eab67da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96a19dbcfba42a3a608847f092212f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:56Z,use_quota=True,user_id='3dbe660f627649e8b51dcec477b8fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d221774b-9dc3-495b-b001-52675df03ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d221774b-9dc3-495b-b001-52675df03ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9975c7f7-a840-4068-865a-a951ef218799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9975c7f7-a840-4068-865a-a951ef218799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c18f0f-507f-4a65-a043-92225eab67da', 'volume_name': 'volume-83c18f0f-507f-4a65-a043-92225eab67da', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62e5b15-8820-42ce-b691-fd7b8884b31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62e5b15-8820-42ce-b691-fd7b8884b31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80a818f-d140-44ee-9e3d-86ab0f1a3f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Volume 83c18f0f-507f-4a65-a043-92225eab67da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c18f0f-507f-4a65-a043-92225eab67da', 'volume_size': 1} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-411778730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c18f0f-507f-4a65-a043-92225eab67da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96a19dbcfba42a3a608847f092212f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:56Z,use_quota=True,user_id='3dbe660f627649e8b51dcec477b8fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Creating volume 83c18f0f-507f-4a65-a043-92225eab67da {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:55 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:55 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da 1073741824 Sep 11 23:06:55 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:56 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da 1073741824" returned: 0 in 0.498s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:56 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da Sep 11 23:06:56 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:56 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da" returned: 0 in 0.361s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80a818f-d140-44ee-9e3d-86ab0f1a3f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c18f0f-507f-4a65-a043-92225eab67da', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b23eca2-fbb5-4c89-ab94-8bc117131ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Volume volume-83c18f0f-507f-4a65-a043-92225eab67da (83c18f0f-507f-4a65-a043-92225eab67da): created successfully Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b23eca2-fbb5-4c89-ab94-8bc117131ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Flow 'volume_create_manager' (e8ab125a-1ea7-46d9-b593-dbb1456c6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-38636f6a-5b66-48a4-ba92-32fc10f38de1 tempest-VolumeQuotasAdminTestJSON-893367650 None] Created volume successfully. Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (2d7b32c7-dbce-4db3-8d5a-8f1cdb94be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9ce0fe-3931-4bd9-8762-a38dc4626bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9ce0fe-3931-4bd9-8762-a38dc4626bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-558275410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352cba36-998c-4826-b240-472368f071ee,host='devstack@QuobyteHD#QuobyteHD',id=2f791370-5308-46d3-a955-acaaa17f7231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:57Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5d5eadf-effe-4586-8cd2-7a72cabd0eab),volume_type_id=a5d5eadf-effe-4586-8cd2-7a72cabd0eab)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed688e20-c98e-4959-8ac3-b4b16864d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed688e20-c98e-4959-8ac3-b4b16864d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2117101-e111-4e8a-9b26-c9ed9830d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2117101-e111-4e8a-9b26-c9ed9830d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f791370-5308-46d3-a955-acaaa17f7231', 'volume_name': 'volume-2f791370-5308-46d3-a955-acaaa17f7231', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37475933-060d-40ef-8bfe-32d53b239a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37475933-060d-40ef-8bfe-32d53b239a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51d4684-115e-4c55-819e-817f3763132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Volume 2f791370-5308-46d3-a955-acaaa17f7231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f791370-5308-46d3-a955-acaaa17f7231', 'volume_size': 1} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=352cba36-998c-4826-b240-472368f071ee,created_at=2026-09-11T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-558275410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352cba36-998c-4826-b240-472368f071ee,host='devstack@QuobyteHD#QuobyteHD',id=2f791370-5308-46d3-a955-acaaa17f7231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:57Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5d5eadf-effe-4586-8cd2-7a72cabd0eab),volume_type_id=a5d5eadf-effe-4586-8cd2-7a72cabd0eab)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Creating volume 2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:56 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:56 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 1073741824 Sep 11 23:06:56 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Flow 'volume_create_manager' (fb8a43c7-94e4-4a9b-83eb-04ad3ae22e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7602f6e-f092-4721-91d4-6d1d2fbc4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7602f6e-f092-4721-91d4-6d1d2fbc4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1605875766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9559e40-1bc0-451e-80f9-daf99e5b7115,host='devstack@QuobyteHD#QuobyteHD',id=0189cdc5-20a4-4270-8d30-429ff83089a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d451eea24e5849e8a570ecbcdc6e511e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:57Z,use_quota=True,user_id='912a17800e1046458c05cb73760efb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d8d354e-dae4-453c-b876-bfabb0c6ec20),volume_type_id=6d8d354e-dae4-453c-b876-bfabb0c6ec20)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6938085c-58b1-4b04-a820-2bb8e4c81e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6938085c-58b1-4b04-a820-2bb8e4c81e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd602d32-6662-4a85-a5e8-ff764916145e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd602d32-6662-4a85-a5e8-ff764916145e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0189cdc5-20a4-4270-8d30-429ff83089a3', 'volume_name': 'volume-0189cdc5-20a4-4270-8d30-429ff83089a3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e073f3-11ef-4080-8cee-9bf25fa3b1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e073f3-11ef-4080-8cee-9bf25fa3b1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0e802d-08a6-4941-81d1-7d6879455a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Volume 0189cdc5-20a4-4270-8d30-429ff83089a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0189cdc5-20a4-4270-8d30-429ff83089a3', 'volume_size': 1} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:57 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 1073741824" returned: 0 in 0.727s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:57 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 Sep 11 23:06:57 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:57 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9559e40-1bc0-451e-80f9-daf99e5b7115,created_at=2026-09-11T21:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1605875766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9559e40-1bc0-451e-80f9-daf99e5b7115,host='devstack@QuobyteHD#QuobyteHD',id=0189cdc5-20a4-4270-8d30-429ff83089a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d451eea24e5849e8a570ecbcdc6e511e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:57Z,use_quota=True,user_id='912a17800e1046458c05cb73760efb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d8d354e-dae4-453c-b876-bfabb0c6ec20),volume_type_id=6d8d354e-dae4-453c-b876-bfabb0c6ec20)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Creating volume 0189cdc5-20a4-4270-8d30-429ff83089a3 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:57 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51d4684-115e-4c55-819e-817f3763132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f791370-5308-46d3-a955-acaaa17f7231', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 1073741824 Sep 11 23:06:57 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b579ae9-8790-479f-97d7-8ab0d22f7f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Volume volume-2f791370-5308-46d3-a955-acaaa17f7231 (2f791370-5308-46d3-a955-acaaa17f7231): created successfully Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b579ae9-8790-479f-97d7-8ab0d22f7f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (2d7b32c7-dbce-4db3-8d5a-8f1cdb94be59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-70811659-9eac-4b82-a83a-321252789b49 tempest-VolumeQuotasAdminTestJSON-2130222149 None] Transfer volume completed successfully. Sep 11 23:06:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eb354d31-16f4-4f07-8899-947bbdf9321b tempest-GroupSnapshotsTest-1064308120 None] Created volume successfully. Sep 11 23:06:58 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 1073741824" returned: 0 in 0.551s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:58 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 Sep 11 23:06:58 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Acquiring lock "cinder-83c18f0f-507f-4a65-a043-92225eab67da-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:58 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Lock "cinder-83c18f0f-507f-4a65-a043-92225eab67da-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3" returned: 0 in 0.297s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0e802d-08a6-4941-81d1-7d6879455a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0189cdc5-20a4-4270-8d30-429ff83089a3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739245d7-ab2e-416d-95ed-e28eb6fe060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Volume volume-0189cdc5-20a4-4270-8d30-429ff83089a3 (0189cdc5-20a4-4270-8d30-429ff83089a3): created successfully Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739245d7-ab2e-416d-95ed-e28eb6fe060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Flow 'volume_create_manager' (fb8a43c7-94e4-4a9b-83eb-04ad3ae22e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Acquiring lock "cinder-quobyte-83c18f0f-507f-4a65-a043-92225eab67da" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-45ab2cf5-596e-4075-b740-48b0f1d7578c tempest-GroupsTest-1332969015 None] Created volume successfully. Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Lock "cinder-quobyte-83c18f0f-507f-4a65-a043-92225eab67da" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b376f540-b021-4e90-9400-caad3d38d98e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:59 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:06:59 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (96e3e9fe-fe16-416a-96df-81e4f7eec9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24eb203-195f-44bf-9e17-24020f401229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24eb203-195f-44bf-9e17-24020f401229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1360609946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352cba36-998c-4826-b240-472368f071ee,host='devstack@QuobyteHD#QuobyteHD',id=1bea1518-6042-4d07-bb45-bd6d0b1d6999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:59Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5d5eadf-effe-4586-8cd2-7a72cabd0eab),volume_type_id=a5d5eadf-effe-4586-8cd2-7a72cabd0eab)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656714a4-875e-4618-9f3c-3bf8c91c47c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656714a4-875e-4618-9f3c-3bf8c91c47c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edc77f9-42c5-4f70-8760-7575d267a51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edc77f9-42c5-4f70-8760-7575d267a51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bea1518-6042-4d07-bb45-bd6d0b1d6999', 'volume_name': 'volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bca2a4-aed1-4969-8558-b8ca6a40bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bca2a4-aed1-4969-8558-b8ca6a40bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697a32cc-5528-42bb-a7e2-4a9694453804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Volume 1bea1518-6042-4d07-bb45-bd6d0b1d6999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999', 'volume_size': 1} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=352cba36-998c-4826-b240-472368f071ee,created_at=2026-09-11T21:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1360609946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352cba36-998c-4826-b240-472368f071ee,host='devstack@QuobyteHD#QuobyteHD',id=1bea1518-6042-4d07-bb45-bd6d0b1d6999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:59Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5d5eadf-effe-4586-8cd2-7a72cabd0eab),volume_type_id=a5d5eadf-effe-4586-8cd2-7a72cabd0eab)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Creating volume 1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:59 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:59 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 1073741824 Sep 11 23:06:59 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:59 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da Sep 11 23:06:59 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:59 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.286s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:59 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Flow 'volume_create_manager' (e21f5bea-8d04-49c1-a454-d9a040e0f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5073806-ff71-40e0-a05a-e1627d8c11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da" returned: 0 in 0.503s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5073806-ff71-40e0-a05a-e1627d8c11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1126839579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b91c037-bf98-43a1-8905-83c56690c270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b5d9f9b2254235b44060d3de9582a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:59Z,use_quota=True,user_id='ac06487025be46f996f78e050317fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da Sep 11 23:06:59 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b2af6f-3d12-4e59-b35d-955662ae699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b2af6f-3d12-4e59-b35d-955662ae699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69de5d6a-a3ee-497c-9eb9-ede6d3db220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69de5d6a-a3ee-497c-9eb9-ede6d3db220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b91c037-bf98-43a1-8905-83c56690c270', 'volume_name': 'volume-3b91c037-bf98-43a1-8905-83c56690c270', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11060ce7-170e-4427-8b3d-cb1255e7b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11060ce7-170e-4427-8b3d-cb1255e7b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9686ac0c-6eab-4ee0-89cb-d6b4191eac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Volume 3b91c037-bf98-43a1-8905-83c56690c270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b91c037-bf98-43a1-8905-83c56690c270', 'volume_size': 1} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:59 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 1073741824" returned: 0 in 0.464s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:59 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 Sep 11 23:06:59 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:59 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-83c18f0f-507f-4a65-a043-92225eab67da" returned: 0 in 0.273s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Lock "cinder-quobyte-83c18f0f-507f-4a65-a043-92225eab67da" released by "delete_volume" :: held 0.836s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Created reservations ['c4461143-f879-4a7b-929c-115d68537f51', '3b34d85f-94b3-406b-80bc-5547844da502', '76c314ed-6fa7-437a-b14d-e4b53f5fa5f5', '225bb23e-3e0a-4cf4-998a-56d01e8583ce'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:59 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999" returned: 0 in 0.267s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1126839579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b91c037-bf98-43a1-8905-83c56690c270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b5d9f9b2254235b44060d3de9582a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:59Z,use_quota=True,user_id='ac06487025be46f996f78e050317fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Creating volume 3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:00 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 1073741824 Sep 11 23:07:00 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697a32cc-5528-42bb-a7e2-4a9694453804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:00 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d83095-5b1b-4aa1-90fb-7e51e673474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Volume volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 (1bea1518-6042-4d07-bb45-bd6d0b1d6999): created successfully Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d83095-5b1b-4aa1-90fb-7e51e673474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (96e3e9fe-fe16-416a-96df-81e4f7eec9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-df602fee-065a-4c66-ba5d-815577202f26 tempest-GroupSnapshotsTest-1064308120 None] Created volume successfully. Sep 11 23:07:00 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.328s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Deleted volume successfully. Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dc957d34-e8f1-45aa-9b93-612749001f6c tempest-VolumeQuotasAdminTestJSON-1603594196 None] Lock "cinder-83c18f0f-507f-4a65-a043-92225eab67da-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Acquiring lock "cinder-quobyte-0189cdc5-20a4-4270-8d30-429ff83089a3" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Lock "cinder-quobyte-0189cdc5-20a4-4270-8d30-429ff83089a3" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[336cfbe2-73f1-418a-9d47-349e530f5cf9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 1073741824" returned: 0 in 0.617s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:00 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 Sep 11 23:07:00 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.262s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9686ac0c-6eab-4ee0-89cb-d6b4191eac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b91c037-bf98-43a1-8905-83c56690c270', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41976e19-c762-457a-8817-6367d1011545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Volume volume-3b91c037-bf98-43a1-8905-83c56690c270 (3b91c037-bf98-43a1-8905-83c56690c270): created successfully Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41976e19-c762-457a-8817-6367d1011545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Flow 'volume_create_manager' (e21f5bea-8d04-49c1-a454-d9a040e0f472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dd11376f-1e89-4bc5-a658-2c3930103082 tempest-VolumesDeleteCascade-1728778968 None] Created volume successfully. Sep 11 23:07:01 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3" returned: 0 in 0.457s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:01 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3 Sep 11 23:07:01 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:01 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0189cdc5-20a4-4270-8d30-429ff83089a3" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Lock "cinder-quobyte-0189cdc5-20a4-4270-8d30-429ff83089a3" released by "delete_volume" :: held 0.794s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Created reservations ['0dedd2eb-49e1-4234-9efd-e5049448809d'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:01 devstack cinder-volume[88002]: WARNING cinder.quota [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-430517974 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-430517974, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:01 devstack cinder-volume[88002]: WARNING cinder.quota [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-430517974 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-430517974, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Created reservations ['9163a0cd-1e97-4b26-8ba8-b4b5a7dbbccf', '9ef5d50d-b4f6-4d3c-ad85-d734214329c1', 'e9630dfc-90ba-4024-9c11-0325f6cf5a99', '072f652a-e4fa-4f6a-a93a-4efca92bb50a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7c3250ba-2f32-4335-b84d-a7ace1ef3537 tempest-GroupSnapshotsTest-1064308120 None] Update group completed successfully. Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:01 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:01 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:01 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a11745eb-208c-45ac-8cca-1389aec545b4 tempest-GroupsTest-1332969015 None] Delete group completed successfully. Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Creating offline snapshot 810c62b4-08fe-4afa-81a5-624d29a23743 of volume 3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[be89b1f4-80c3-43a2-a966-5e371bbb5a3c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Created reservations ['5e469bdb-9af5-4c43-89d4-8f7e7c70e14b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:02 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:02 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:02 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:02 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:02 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.382s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:02 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.298s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eb720720-331b-4358-a880-ff5157c18a03 tempest-GroupsTest-1332969015 None] Delete group completed successfully. Sep 11 23:07:02 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 1G Sep 11 23:07:02 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7d763a0c-2016-4f88-b2f3-1513feaf2abf tempest-GroupSnapshotsTest-1064308120 None] Update group completed successfully. Sep 11 23:07:02 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 1G" returned: 0 in 0.526s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:02 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:02 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:03 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.377s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:03 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 is being set with open permissions: ugo+rw Sep 11 23:07:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:03 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:03 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:03 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:03 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info Sep 11 23:07:03 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3f4ac1e2-37c9-42b9-8e23-1cdedce54aed tempest-GroupsTest-1332969015 None] Group tempest-GroupsTest-Group-406468233: creating Sep 11 23:07:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3f4ac1e2-37c9-42b9-8e23-1cdedce54aed tempest-GroupsTest-1332969015 None] Group tempest-GroupsTest-Group-406468233: created successfully Sep 11 23:07:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3f4ac1e2-37c9-42b9-8e23-1cdedce54aed tempest-GroupsTest-1332969015 None] Create group completed successfully. Sep 11 23:07:03 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info" returned: 0 in 0.291s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:03 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info is being set with open permissions: ugo+rw Sep 11 23:07:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:03 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info Sep 11 23:07:04 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7b4ae992-9fbc-45d8-8306-8b48b0b03c8e tempest-GroupSnapshotsTest-1064308120 None] Update group completed successfully. Sep 11 23:07:04 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.info" returned: 0 in 0.385s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a5f35b15-cf4b-469c-96c7-ee0d475d885a tempest-VolumesDeleteCascade-1728778968 None] Create snapshot completed successfully Sep 11 23:07:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-65ea85c4-2419-4e1e-b4fc-02e8932549b1 tempest-GroupSnapshotsTest-1064308120 None] Update group completed successfully. Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Flow 'volume_create_manager' (559c3e88-ed9f-4b1d-b6b4-bbbc9e883328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f03c8e-0718-4e8f-bb40-749b0567d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f03c8e-0718-4e8f-bb40-749b0567d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469529500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ff81f43-9862-4103-aca3-f05c8bfc9d86,host='devstack@QuobyteHD#QuobyteHD',id=be51f520-15de-484d-be61-909880451a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d451eea24e5849e8a570ecbcdc6e511e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:05Z,use_quota=True,user_id='912a17800e1046458c05cb73760efb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c633497a-74dd-4548-8b84-d8cbc2958b11),volume_type_id=c633497a-74dd-4548-8b84-d8cbc2958b11)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2396c0e9-8b47-4bab-9263-5449226997f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2396c0e9-8b47-4bab-9263-5449226997f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dc4380-3ffc-469f-b2e7-b22deb9376fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dc4380-3ffc-469f-b2e7-b22deb9376fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be51f520-15de-484d-be61-909880451a92', 'volume_name': 'volume-be51f520-15de-484d-be61-909880451a92', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bfb1e6-9dd1-4761-8f07-e7c479cce844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bfb1e6-9dd1-4761-8f07-e7c479cce844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c42b4e6-49ea-47fb-a92a-16e3c3b2e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Volume be51f520-15de-484d-be61-909880451a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be51f520-15de-484d-be61-909880451a92', 'volume_size': 1} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ff81f43-9862-4103-aca3-f05c8bfc9d86,created_at=2026-09-11T21:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469529500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ff81f43-9862-4103-aca3-f05c8bfc9d86,host='devstack@QuobyteHD#QuobyteHD',id=be51f520-15de-484d-be61-909880451a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d451eea24e5849e8a570ecbcdc6e511e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:05Z,use_quota=True,user_id='912a17800e1046458c05cb73760efb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c633497a-74dd-4548-8b84-d8cbc2958b11),volume_type_id=c633497a-74dd-4548-8b84-d8cbc2958b11)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Creating volume be51f520-15de-484d-be61-909880451a92 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:05 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:05 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 1073741824 Sep 11 23:07:05 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:06 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 1073741824" returned: 0 in 0.448s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:06 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 Sep 11 23:07:06 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:06 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92" returned: 0 in 0.252s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.735s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Creating offline snapshot 878c471d-5986-4d2d-ac82-d1212a45f30f of volume 3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c42b4e6-49ea-47fb-a92a-16e3c3b2e586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be51f520-15de-484d-be61-909880451a92', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddf0967-dabe-4c72-8d6e-a24d80172df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e4b1b-6dbf-4ab1-9ec9-5fe7867d1702]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Volume volume-be51f520-15de-484d-be61-909880451a92 (be51f520-15de-484d-be61-909880451a92): created successfully Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddf0967-dabe-4c72-8d6e-a24d80172df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Flow 'volume_create_manager' (559c3e88-ed9f-4b1d-b6b4-bbbc9e883328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c6ff06e5-5ba4-4868-a8e9-a80f0d769e27 tempest-GroupsTest-1332969015 None] Created volume successfully. Sep 11 23:07:06 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:06 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:06 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.472s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b91c037-bf98-43a1-8905-83c56690c270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:06 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f 1G Sep 11 23:07:06 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] GroupSnapshot 15900eca-6348-440f-b694-b7a7249fa673: creating. Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Group snapshot 15900eca-6348-440f-b694-b7a7249fa673: creating. {{(pid=88002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Flow 'volume_create_manager' (28d39834-2df9-4614-b41d-39c5830c1f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d4993-14f8-43de-904e-5cd67e7f3e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d4993-14f8-43de-904e-5cd67e7f3e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065202151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ff81f43-9862-4103-aca3-f05c8bfc9d86,host='devstack@QuobyteHD#QuobyteHD',id=1e178796-daf4-4f93-b60c-2d7c509d38c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d451eea24e5849e8a570ecbcdc6e511e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:07Z,use_quota=True,user_id='912a17800e1046458c05cb73760efb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c633497a-74dd-4548-8b84-d8cbc2958b11),volume_type_id=c633497a-74dd-4548-8b84-d8cbc2958b11)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32437ca-0aa7-43f4-8038-064da23846b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32437ca-0aa7-43f4-8038-064da23846b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08036e98-10d8-401e-9a11-9817876c5813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08036e98-10d8-401e-9a11-9817876c5813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e178796-daf4-4f93-b60c-2d7c509d38c0', 'volume_name': 'volume-1e178796-daf4-4f93-b60c-2d7c509d38c0', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea789948-e083-430e-bd91-2c6661fa57ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea789948-e083-430e-bd91-2c6661fa57ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffdd5ab-6799-4212-847a-c6c1e920bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:07 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Volume 1e178796-daf4-4f93-b60c-2d7c509d38c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e178796-daf4-4f93-b60c-2d7c509d38c0', 'volume_size': 1} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:07 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f 1G" returned: 0 in 0.625s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:07 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f Sep 11 23:07:07 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:07 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f" returned: 0 in 0.322s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:07 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f is being set with open permissions: ugo+rw Sep 11 23:07:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:07 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f Sep 11 23:07:07 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:08 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.960s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Creating offline snapshot ac85555c-12d2-4cb3-80e6-60e5793adfc5 of volume 2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5195996f-1c30-4bd4-935e-f5b801191f5e tempest-VolumesDeleteCascade-1728778968 None] Create snapshot completed successfully Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc80a6d-acc4-44bd-8282-cabb68a56240]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:08 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 Sep 11 23:07:08 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:08 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231" returned: 0 in 0.375s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:08 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 1G Sep 11 23:07:08 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-3b91c037-bf98-43a1-8905-83c56690c270-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-3b91c037-bf98-43a1-8905-83c56690c270-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Performing cascade delete. {{(pid=88002) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-810c62b4-08fe-4afa-81a5-624d29a23743-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-810c62b4-08fe-4afa-81a5-624d29a23743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-810c62b4-08fe-4afa-81a5-624d29a23743" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-810c62b4-08fe-4afa-81a5-624d29a23743" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Deleting offline snapshot 810c62b4-08fe-4afa-81a5-624d29a23743 of volume 3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] snapshot_file for this snap is: volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c55ad32-3a9e-4950-8b56-1af59dc73b27]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:08 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:08 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 1G" returned: 0 in 0.464s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f791370-5308-46d3-a955-acaaa17f7231 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f791370-5308-46d3-a955-acaaa17f7231 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 Sep 11 23:07:09 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.396s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b91c037-bf98-43a1-8905-83c56690c270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c06ed1-2e0a-42b2-87d8-b154ef47c736]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f791370-5308-46d3-a955-acaaa17f7231 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5" returned: 0 in 0.304s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:09 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 Sep 11 23:07:09 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.393s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info Sep 11 23:07:09 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[55208df1-0665-40cb-bb17-2ba835da41ed]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f Sep 11 23:07:09 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info" returned: 0 in 0.259s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info Sep 11 23:07:09 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:10 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f" returned: 0 in 0.410s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b91c037-bf98-43a1-8905-83c56690c270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b850e9d6-eced-4594-bbcc-0974ad499e2a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.info" returned: 0 in 0.302s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Creating offline snapshot beddfc7b-acd8-4843-8d4b-d8756f47c9ab of volume 1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:10 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:10 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1fedb-4d73-430d-9b9c-796b1ca52392]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 Sep 11 23:07:10 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:10 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b91c037-bf98-43a1-8905-83c56690c270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5750e2-1759-47ba-92f4-c09d7956840c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:10 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:10 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999" returned: 0 in 0.385s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab 1G Sep 11 23:07:10 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:10 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.427s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:10 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab 1G" returned: 0 in 0.513s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab Sep 11 23:07:11 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.419s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743 Sep 11 23:07:11 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab Sep 11 23:07:11 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.810c62b4-08fe-4afa-81a5-624d29a23743" returned: 0 in 0.267s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f -F qcow2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f -F qcow2 Sep 11 23:07:11 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab" returned: 0 in 0.267s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info Sep 11 23:07:11 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91c037-bf98-43a1-8905-83c56690c270 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f -F qcow2" returned: 0 in 0.351s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-810c62b4-08fe-4afa-81a5-624d29a23743" released by "_delete_snapshot" :: held 3.263s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" released by "delete_snapshot" :: held 3.290s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:12 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info" returned: 0 in 0.289s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:12 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Created reservations ['412871e6-37cb-4e29-b408-f264c9fce171', '7e3a9e01-f947-4cc0-8639-084c3a48bd8e', '120b59e7-060d-4904-90bd-f3b96d4a33a5', 'fbd0808a-bf24-477a-8a22-7302445ad92c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:12 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info Sep 11 23:07:12 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Delete snapshot completed successfully. Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-810c62b4-08fe-4afa-81a5-624d29a23743-delete_snapshot" released by "delete_snapshot" :: held 3.471s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-878c471d-5986-4d2d-ac82-d1212a45f30f-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-878c471d-5986-4d2d-ac82-d1212a45f30f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-878c471d-5986-4d2d-ac82-d1212a45f30f" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-878c471d-5986-4d2d-ac82-d1212a45f30f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Deleting offline snapshot 878c471d-5986-4d2d-ac82-d1212a45f30f of volume 3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] snapshot_file for this snap is: volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2acc73d-87a9-4c42-aeb2-0788d9b31e65]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:12 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.info" returned: 0 in 0.256s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.972s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ff81f43-9862-4103-aca3-f05c8bfc9d86,created_at=2026-09-11T21:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065202151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ff81f43-9862-4103-aca3-f05c8bfc9d86,host='devstack@QuobyteHD#QuobyteHD',id=1e178796-daf4-4f93-b60c-2d7c509d38c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d451eea24e5849e8a570ecbcdc6e511e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:07Z,use_quota=True,user_id='912a17800e1046458c05cb73760efb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c633497a-74dd-4548-8b84-d8cbc2958b11),volume_type_id=c633497a-74dd-4548-8b84-d8cbc2958b11)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Creating volume 1e178796-daf4-4f93-b60c-2d7c509d38c0 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:12 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:12 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 1073741824 Sep 11 23:07:12 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:12 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f Sep 11 23:07:12 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f64eed01-6a07-4489-8cba-c21d35746fee tempest-GroupSnapshotsTest-1064308120 None] group_snapshot 15900eca-6348-440f-b694-b7a7249fa673: created successfully Sep 11 23:07:12 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b91c037-bf98-43a1-8905-83c56690c270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d80cb-f878-456e-ada1-5491e2fb4daf]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:12 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:12 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:12 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 1073741824" returned: 0 in 0.498s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:12 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 Sep 11 23:07:12 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.422s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f Sep 11 23:07:13 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0" returned: 0 in 0.302s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffdd5ab-6799-4212-847a-c6c1e920bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e178796-daf4-4f93-b60c-2d7c509d38c0', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e498e62-b2ab-40e2-abf8-7cc0084b63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Volume volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 (1e178796-daf4-4f93-b60c-2d7c509d38c0): created successfully Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e498e62-b2ab-40e2-abf8-7cc0084b63ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Flow 'volume_create_manager' (28d39834-2df9-4614-b41d-39c5830c1f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a8011e23-b1e7-4cb9-9f17-7785c6d326dd tempest-GroupsTest-1332969015 None] Created volume successfully. Sep 11 23:07:13 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f" returned: 0 in 0.369s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f Sep 11 23:07:13 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot 15900eca-6348-440f-b694-b7a7249fa673: deleting Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot 15900eca-6348-440f-b694-b7a7249fa673: deleting {{(pid=88002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-2f791370-5308-46d3-a955-acaaa17f7231" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-2f791370-5308-46d3-a955-acaaa17f7231" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-ac85555c-12d2-4cb3-80e6-60e5793adfc5" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-ac85555c-12d2-4cb3-80e6-60e5793adfc5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Deleting offline snapshot ac85555c-12d2-4cb3-80e6-60e5793adfc5 of volume 2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] snapshot_file for this snap is: volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8c249f-05d8-4cee-88b9-070171887192]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270.878c471d-5986-4d2d-ac82-d1212a45f30f" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-878c471d-5986-4d2d-ac82-d1212a45f30f" released by "_delete_snapshot" :: held 1.573s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" released by "delete_snapshot" :: held 1.599s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:13 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 Sep 11 23:07:13 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Created reservations ['3f32bf46-d672-4823-acbe-904ec15b8feb', 'bf23c18a-8cb5-4ee8-9ee5-19ca59783981', '1aacc293-6988-4e90-a248-3e4019cbd424', 'baa192b5-2572-4b62-a17b-a774f19f9b90'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Delete snapshot completed successfully. Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-878c471d-5986-4d2d-ac82-d1212a45f30f-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Snapshots deleted, issuing volume delete {{(pid=88002) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5646bd0-8cab-4c5c-87e5-7a4400cdfcfd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:14 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:14 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5" returned: 0 in 0.425s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f791370-5308-46d3-a955-acaaa17f7231(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53fbcb3-f603-4e87-b78b-77ef0a379ddc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:14 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 Sep 11 23:07:14 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Flow 'volume_create_manager' (1f386079-6e4e-485a-8a37-ea438c5f0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d57ce-6738-48e0-a8f6-51c8b19303a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d57ce-6738-48e0-a8f6-51c8b19303a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-756924822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5cdb9-51b3-4c1c-9141-74260049a546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8dd9af34d44378b5d8e214815068cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:14Z,use_quota=True,user_id='fece89619991427996c5cda2df2d0b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3cc212-5075-4dda-a3ca-14840eca3658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3cc212-5075-4dda-a3ca-14840eca3658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c823b7-3a9a-4cf1-adae-40b62dde0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c823b7-3a9a-4cf1-adae-40b62dde0052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac5cdb9-51b3-4c1c-9141-74260049a546', 'volume_name': 'volume-0ac5cdb9-51b3-4c1c-9141-74260049a546', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9c22b5-9ac3-48a0-9da8-2dace121265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:14 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9c22b5-9ac3-48a0-9da8-2dace121265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a56df9a-04cb-4147-a19a-c40b92245f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:14 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Volume 0ac5cdb9-51b3-4c1c-9141-74260049a546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac5cdb9-51b3-4c1c-9141-74260049a546', 'volume_size': 1} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-756924822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5cdb9-51b3-4c1c-9141-74260049a546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8dd9af34d44378b5d8e214815068cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:14Z,use_quota=True,user_id='fece89619991427996c5cda2df2d0b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Creating volume 0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:14 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:14 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 1073741824 Sep 11 23:07:14 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.511s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:14 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270 Sep 11 23:07:14 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-04f6686d-51b5-420a-8d44-dcdb77d4aa6f tempest-GroupsTest-1332969015 None] Update group completed successfully. Sep 11 23:07:14 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231" returned: 0 in 0.427s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:14 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 Sep 11 23:07:14 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b91c037-bf98-43a1-8905-83c56690c270" returned: 0 in 0.265s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-3b91c037-bf98-43a1-8905-83c56690c270" released by "delete_volume" :: held 0.841s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Created reservations ['bdeb72e4-8d70-4437-b9d7-69bf4c58393e', '1f5c9faa-5203-4ec5-8496-447d5a74a2e6', 'c6d3de68-44b0-4532-8ba1-e56a837e937c', 'dd6d8057-120e-4484-98d5-622c89673f97'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:14 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:14 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 1073741824" returned: 0 in 0.475s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 Sep 11 23:07:15 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:15 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5 Sep 11 23:07:15 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:15 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.274s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Deleted volume successfully. Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4ca4ac9-ff66-4678-a11c-2a0b995082b5 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-3b91c037-bf98-43a1-8905-83c56690c270-delete_volume" released by "delete_volume" :: held 6.628s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:15 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231.ac85555c-12d2-4cb3-80e6-60e5793adfc5" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-ac85555c-12d2-4cb3-80e6-60e5793adfc5" released by "_delete_snapshot" :: held 1.644s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a56df9a-04cb-4147-a19a-c40b92245f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac5cdb9-51b3-4c1c-9141-74260049a546', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab16addd-864f-4603-a1d2-da3add46211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-2f791370-5308-46d3-a955-acaaa17f7231" released by "delete_snapshot" :: held 1.682s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Volume volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 (0ac5cdb9-51b3-4c1c-9141-74260049a546): created successfully Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab16addd-864f-4603-a1d2-da3add46211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Flow 'volume_create_manager' (1f386079-6e4e-485a-8a37-ea438c5f0d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-1bea1518-6042-4d07-bb45-bd6d0b1d6999" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-49d2dd23-dfd0-409a-b652-65ca444c32fa tempest-SnapshotMetadataTestJSON-1206004487 None] Created volume successfully. Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-1bea1518-6042-4d07-bb45-bd6d0b1d6999" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-beddfc7b-acd8-4843-8d4b-d8756f47c9ab" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-beddfc7b-acd8-4843-8d4b-d8756f47c9ab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Deleting offline snapshot beddfc7b-acd8-4843-8d4b-d8756f47c9ab of volume 1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] snapshot_file for this snap is: volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7f1e4b-c2be-4a02-85ab-9af5f89dd8f4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab Sep 11 23:07:15 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:15 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab" returned: 0 in 0.415s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2c6dd9ed-b81c-4a3d-b1eb-f1e45facdd73 tempest-GroupsTest-1332969015 None] Update group completed successfully. Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c617c3-e6f2-4001-b213-d11c275ddadb]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 Sep 11 23:07:16 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Flow 'volume_create_manager' (e0c339aa-e3b2-47e3-bd96-6a2631bc0927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54fdbb0-f40f-46a6-8f40-cf47fd3d925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54fdbb0-f40f-46a6-8f40-cf47fd3d925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-157441275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9d21ed-e875-4b31-aa5d-5139bf913bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b5d9f9b2254235b44060d3de9582a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:16Z,use_quota=True,user_id='ac06487025be46f996f78e050317fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4869bd-5590-495d-9ae5-75bafe143d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4869bd-5590-495d-9ae5-75bafe143d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908e168c-f994-462b-84d7-1364fc1e0bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908e168c-f994-462b-84d7-1364fc1e0bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9d21ed-e875-4b31-aa5d-5139bf913bfb', 'volume_name': 'volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c008ff-cd6b-473b-b505-428789ee2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c008ff-cd6b-473b-b505-428789ee2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cac4693-2d45-4639-bab0-26fb956c63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:16 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Volume ec9d21ed-e875-4b31-aa5d-5139bf913bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb', 'volume_size': 1} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-157441275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9d21ed-e875-4b31-aa5d-5139bf913bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b5d9f9b2254235b44060d3de9582a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:16Z,use_quota=True,user_id='ac06487025be46f996f78e050317fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Creating volume ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:16 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb 1073741824 Sep 11 23:07:16 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999" returned: 0 in 0.376s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab Sep 11 23:07:16 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb 1073741824" returned: 0 in 0.478s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:16 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab" returned: 0 in 0.379s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab Sep 11 23:07:16 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb Sep 11 23:07:16 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999.beddfc7b-acd8-4843-8d4b-d8756f47c9ab" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" returned: 0 in 0.291s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-beddfc7b-acd8-4843-8d4b-d8756f47c9ab" released by "_delete_snapshot" :: held 1.557s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.331s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cac4693-2d45-4639-bab0-26fb956c63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9d0608-d583-4953-acd5-2eb080ca8e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-1bea1518-6042-4d07-bb45-bd6d0b1d6999" released by "delete_snapshot" :: held 1.615s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Creating offline snapshot 3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d of volume 0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:17 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Volume volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb (ec9d21ed-e875-4b31-aa5d-5139bf913bfb): created successfully Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9d0608-d583-4953-acd5-2eb080ca8e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Flow 'volume_create_manager' (e0c339aa-e3b2-47e3-bd96-6a2631bc0927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c110a6db-71a1-4964-8c09-56e0ed64a750]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eebcd1ba-d459-485d-9f41-014c8c19114a tempest-VolumesDeleteCascade-1728778968 None] Created volume successfully. Sep 11 23:07:17 devstack cinder-volume[88002]: WARNING cinder.quota [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-808892425 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-808892425, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:17 devstack cinder-volume[88002]: WARNING cinder.quota [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-808892425 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-808892425, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['1eafa938-07b2-4940-9c80-fbc0e814420c', '11f362fc-c533-4d4a-9242-b727a7ba4911', 'dd903160-6c33-430a-90a5-3106368ef0ea', '5ac42687-44c0-4622-9c80-eb08b4a475b7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:17 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 Sep 11 23:07:17 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['caef26e5-c448-476a-8132-504fab484cda', '5143a761-9b8b-476b-aaed-191c3d073c2e', '11a90ce7-4c6c-4458-acbe-b93110962636', '5b3c160f-1410-401c-ab6a-2a6c38deb1c5'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f646c657-b857-4dfe-87dc-5ef8621b9fb5 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot 15900eca-6348-440f-b694-b7a7249fa673: deleted successfully Sep 11 23:07:17 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546" returned: 0 in 0.402s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:17 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d 1G Sep 11 23:07:17 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Acquiring lock "cinder-quobyte-1e178796-daf4-4f93-b60c-2d7c509d38c0" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Lock "cinder-quobyte-1e178796-daf4-4f93-b60c-2d7c509d38c0" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac63c70-ad04-4279-97f9-9f36154115a2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:17 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 Sep 11 23:07:17 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:17 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d 1G" returned: 0 in 0.397s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:17 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d Sep 11 23:07:17 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0 Sep 11 23:07:18 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d is being set with open permissions: ugo+rw Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d Sep 11 23:07:18 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1e178796-daf4-4f93-b60c-2d7c509d38c0" returned: 0 in 0.317s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Lock "cinder-quobyte-1e178796-daf4-4f93-b60c-2d7c509d38c0" released by "delete_volume" :: held 0.749s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Acquiring lock "cinder-quobyte-be51f520-15de-484d-be61-909880451a92" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Lock "cinder-quobyte-be51f520-15de-484d-be61-909880451a92" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8d24d9-9ca7-4ef0-8a28-c9a0d2278929]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:18 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" returned: 0 in 0.289s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 Sep 11 23:07:18 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info Sep 11 23:07:18 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-1bea1518-6042-4d07-bb45-bd6d0b1d6999" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-1bea1518-6042-4d07-bb45-bd6d0b1d6999" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9838a6e0-f96d-454d-8ae0-cf1fc95b3a41]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info" returned: 0 in 0.288s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info is being set with open permissions: ugo+rw Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 Sep 11 23:07:18 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info Sep 11 23:07:18 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92" returned: 0 in 0.476s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:18 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92 Sep 11 23:07:18 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.info" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.678s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:19 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Creating offline snapshot d86bbdc9-940a-4898-85e1-75aaadd38ab1 of volume ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:19 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999 Sep 11 23:07:19 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be51f520-15de-484d-be61-909880451a92" returned: 0 in 0.278s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0c03cb-a8b5-438f-a8fe-83baef20a8d5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-015a9c99-c4a0-4046-81ac-743f111dc38d tempest-SnapshotMetadataTestJSON-1206004487 None] Create snapshot completed successfully Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Lock "cinder-quobyte-be51f520-15de-484d-be61-909880451a92" released by "delete_volume" :: held 0.824s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Created reservations ['5566667b-a2d1-4b6a-ad9c-7d752e86f86f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:19 devstack cinder-volume[88002]: WARNING cinder.quota [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1604845859 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1604845859, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:19 devstack cinder-volume[88002]: WARNING cinder.quota [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1604845859 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1604845859, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:19 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb Sep 11 23:07:19 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Created reservations ['ba2a67b5-aaa8-4497-8517-3888a87a77c5', '9fff9ab0-f6d2-4dcd-936d-0e59c5c49bff', '5b274b0b-ca43-4137-984a-ef36dced89ed', 'e44fb53d-304f-40c9-935a-02e8471e9aef'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:19 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1bea1518-6042-4d07-bb45-bd6d0b1d6999" returned: 0 in 0.254s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-1bea1518-6042-4d07-bb45-bd6d0b1d6999" released by "delete_volume" :: held 0.742s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-2f791370-5308-46d3-a955-acaaa17f7231" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-2f791370-5308-46d3-a955-acaaa17f7231" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Created reservations ['83f929ed-7c63-41ef-bc10-93cafd43f651', '37a91452-9e7b-4653-993f-02b253113675', '202f6f7a-1317-4da6-a909-371b9a7d60b0', 'f9f81d03-b614-474d-898d-2f88f7396822'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4212ad-3fe0-4718-b8a4-197ccd2694ad]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" returned: 0 in 0.419s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 Sep 11 23:07:19 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:19 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 1G Sep 11 23:07:19 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.273s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-27aef73a-2270-4a7a-b3c4-62f1efe2b284 tempest-GroupsTest-1332969015 None] Delete group completed successfully. Sep 11 23:07:19 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231 Sep 11 23:07:19 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 1G" returned: 0 in 0.497s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:20 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 Sep 11 23:07:20 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2f791370-5308-46d3-a955-acaaa17f7231" returned: 0 in 0.334s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-2f791370-5308-46d3-a955-acaaa17f7231" released by "delete_volume" :: held 0.822s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['52eeda41-b941-431a-a7da-1635896b4cf4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:20 devstack cinder-volume[88002]: WARNING cinder.quota [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-808892425 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-808892425, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['aa98c94f-5172-42d4-884d-007a1a98391a', '2a338612-744a-4604-a95c-1ced0b7a915c', '10c2c44d-b580-43d3-8d05-024cf373f2d6', '42c2da57-4395-42c7-84b8-38fc230bb839'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:20 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1" returned: 0 in 0.432s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 is being set with open permissions: ugo+rw Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:20 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 Sep 11 23:07:20 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['8330441d-c37a-4ab4-9202-52c252022afd', '168e092b-3cd4-47f1-a8ee-37d5e1703497', '6d1bd712-bc13-4e65-b1b7-2f51dcce3056', 'c41209ea-8d0e-4b35-b992-ddd464ce12c3'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:20 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:20 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "cinder-3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:20 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "cinder-quobyte-0ac5cdb9-51b3-4c1c-9141-74260049a546" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-quobyte-0ac5cdb9-51b3-4c1c-9141-74260049a546" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "cinder-quobyte-3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-quobyte-3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Deleting offline snapshot 3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d of volume 0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:20 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info Sep 11 23:07:20 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] snapshot_file for this snap is: volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5e1281-059a-40ed-a44b-7e84d1625fd9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:21 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d Sep 11 23:07:21 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:21 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4593f01d-2782-4780-99b9-0f39cb94787a tempest-GroupSnapshotsTest-1064308120 None] Delete group completed successfully. Sep 11 23:07:21 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info" returned: 0 in 0.430s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:21 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info is being set with open permissions: ugo+rw Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:21 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info Sep 11 23:07:21 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:21 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" returned: 0 in 0.510s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ac5cdb9-51b3-4c1c-9141-74260049a546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e79623-c4d4-4e8e-9dd2-2382ef09c2d8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:21 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.info" returned: 0 in 0.302s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:21 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 Sep 11 23:07:21 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-aa48e47f-bd8e-450f-b0a0-379671607713 tempest-GroupSnapshotsTest-1064308120 None] Group tempest-GroupSnapshotsTest-Group-1630016053: creating Sep 11 23:07:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0eb0ba8d-bd1f-462c-863c-778cce2a77bf tempest-VolumesDeleteCascade-1728778968 None] Create snapshot completed successfully Sep 11 23:07:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-aa48e47f-bd8e-450f-b0a0-379671607713 tempest-GroupSnapshotsTest-1064308120 None] Group tempest-GroupSnapshotsTest-Group-1630016053: created successfully Sep 11 23:07:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-aa48e47f-bd8e-450f-b0a0-379671607713 tempest-GroupSnapshotsTest-1064308120 None] Create group completed successfully. Sep 11 23:07:21 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546" returned: 0 in 0.426s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:21 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d Sep 11 23:07:21 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:22 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" returned: 0 in 0.353s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:22 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d Sep 11 23:07:22 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:22 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546.3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-quobyte-3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d" released by "_delete_snapshot" :: held 1.679s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-quobyte-0ac5cdb9-51b3-4c1c-9141-74260049a546" released by "delete_snapshot" :: held 1.729s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Created reservations ['056fb516-52d6-4ce5-a379-0863ab200173', 'd29547c3-7ee1-4243-ad3b-925f26ef4e39', '209600c7-ce2f-4d84-b87f-3e4544090201', '797846f8-7d74-4643-917f-e20bfa458869'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:22 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Delete snapshot completed successfully. Sep 11 23:07:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-443aa17c-fda8-48f5-b6fe-41b02dd2f3a6 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-3c3b2156-8af8-4ca6-aae3-bedb7ce64b2d-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "cinder-0ac5cdb9-51b3-4c1c-9141-74260049a546-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-0ac5cdb9-51b3-4c1c-9141-74260049a546-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Flow 'volume_create_manager' (d11d3c57-c878-41cd-926a-cb38373eba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88c6dd7-ecfb-4c54-ace4-fc6af0e0cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88c6dd7-ecfb-4c54-ace4-fc6af0e0cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-104322467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52930c37-5727-4ff7-aad5-4f2bf03a5aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b5d9f9b2254235b44060d3de9582a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d86bbdc9-940a-4898-85e1-75aaadd38ab1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:23Z,use_quota=True,user_id='ac06487025be46f996f78e050317fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b467c9fb-7222-4c62-9078-dc96d41c9af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b467c9fb-7222-4c62-9078-dc96d41c9af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96d5157-a6a3-4c03-af8a-17a990087321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96d5157-a6a3-4c03-af8a-17a990087321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52930c37-5727-4ff7-aad5-4f2bf03a5aac', 'volume_name': 'volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac', 'volume_size': 1, 'snapshot_id': 'd86bbdc9-940a-4898-85e1-75aaadd38ab1'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4894fe2a-489b-406d-876f-9a0386785a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4894fe2a-489b-406d-876f-9a0386785a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fbd7e5-369f-4735-b1b8-719261161a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Volume 52930c37-5727-4ff7-aad5-4f2bf03a5aac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac', 'volume_size': 1, 'snapshot_id': 'd86bbdc9-940a-4898-85e1-75aaadd38ab1'} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-d86bbdc9-940a-4898-85e1-75aaadd38ab1-52930c37-5727-4ff7-aad5-4f2bf03a5aac" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "cinder-quobyte-0ac5cdb9-51b3-4c1c-9141-74260049a546" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-d86bbdc9-940a-4898-85e1-75aaadd38ab1-52930c37-5727-4ff7-aad5-4f2bf03a5aac" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Creating volume 52930c37-5727-4ff7-aad5-4f2bf03a5aac from snapshot d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-52930c37-5727-4ff7-aad5-4f2bf03a5aac" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-quobyte-0ac5cdb9-51b3-4c1c-9141-74260049a546" acquired by "delete_volume" :: waited 0.043s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-52930c37-5727-4ff7-aad5-4f2bf03a5aac" acquired by "_copy_volume_from_snapshot" :: waited 0.071s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] snapshot: d86bbdc9-940a-4898-85e1-75aaadd38ab1, volume: 52930c37-5727-4ff7-aad5-4f2bf03a5aac, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c21d6da-bb69-4b5f-b603-82304dfd48a3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (073845aa-325e-4e87-a449-005e67a51ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61822fdd-5117-43b3-a48f-10451721d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e91db98-6b96-4b2d-8e02-2fac9397e0b5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61822fdd-5117-43b3-a48f-10451721d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878909432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efea1f8f-0b6b-4d11-9a18-9a700bf9c100,host='devstack@QuobyteHD#QuobyteHD',id=db1e7f3e-8d87-4d15-8131-5d4d3f6680e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:24Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6879644-751a-4919-9e66-7b9738f44c74),volume_type_id=a6879644-751a-4919-9e66-7b9738f44c74)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172593fd-fa45-4b4d-8554-2ad64efd0df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 Sep 11 23:07:23 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172593fd-fa45-4b4d-8554-2ad64efd0df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796e9eeb-ecb6-446e-bff9-aa168cabb36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796e9eeb-ecb6-446e-bff9-aa168cabb36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1e7f3e-8d87-4d15-8131-5d4d3f6680e5', 'volume_name': 'volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80a694-f4fa-472f-b168-6e43c4d6d209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80a694-f4fa-472f-b168-6e43c4d6d209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a222f4c-aa58-42d7-ae6c-3db8b6fb7c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Volume db1e7f3e-8d87-4d15-8131-5d4d3f6680e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5', 'volume_size': 1} Sep 11 23:07:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:23 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 Sep 11 23:07:23 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:24 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546" returned: 0 in 0.406s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:24 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546 Sep 11 23:07:24 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:24 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1" returned: 0 in 0.414s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e78b7e8-a489-404a-aff7-dde99792d38e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:24 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb Sep 11 23:07:24 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:24 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ac5cdb9-51b3-4c1c-9141-74260049a546" returned: 0 in 0.288s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-quobyte-0ac5cdb9-51b3-4c1c-9141-74260049a546" released by "delete_volume" :: held 0.773s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Created reservations ['759676bc-028b-4a20-869e-9edfce852056', 'fc0020d9-b8ab-4bdb-82b0-06098db23c58', 'ad3c46a9-ee5e-4e24-8d7e-3f3f88cf649c', 'd7b83c96-7438-4373-aa3e-8241a3c2031f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:24 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:24 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:24 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" returned: 0 in 0.459s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:24 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac Sep 11 23:07:24 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:24 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:24 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Deleted volume successfully. Sep 11 23:07:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b390ff74-3c08-42a6-bbe1-3dcbfcdd8ce5 tempest-SnapshotMetadataTestJSON-1206004487 None] Lock "cinder-0ac5cdb9-51b3-4c1c-9141-74260049a546-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:29 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=247,cinder:SELECT=229,cinder:INSERT=55,cinder:DELETE=9 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:07:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4ed898e2-966d-4191-85bc-94f30b5c7463 tempest-GroupsV314Test-1265378097 None] Group tempest-GroupsV314Test-Group-1142823295: creating Sep 11 23:07:29 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=230,cinder:UPDATE=220,cinder:DELETE=13,cinder:INSERT=66 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:07:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4ed898e2-966d-4191-85bc-94f30b5c7463 tempest-GroupsV314Test-1265378097 None] Group tempest-GroupsV314Test-Group-1142823295: created successfully Sep 11 23:07:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4ed898e2-966d-4191-85bc-94f30b5c7463 tempest-GroupsV314Test-1265378097 None] Create group completed successfully. Sep 11 23:07:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac" returned: 0 in 5.308s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:29 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:07:29 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Converted 1024.00 MB image at 192.88 MB/s Sep 11 23:07:29 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac is being set with open permissions: ugo+rw Sep 11 23:07:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:29 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac Sep 11 23:07:29 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:30 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-52930c37-5727-4ff7-aad5-4f2bf03a5aac" released by "_copy_volume_from_snapshot" :: held 6.577s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-d86bbdc9-940a-4898-85e1-75aaadd38ab1-52930c37-5727-4ff7-aad5-4f2bf03a5aac" released by "_create_volume_from_snapshot" :: held 6.698s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.735s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=efea1f8f-0b6b-4d11-9a18-9a700bf9c100,created_at=2026-09-11T21:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878909432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efea1f8f-0b6b-4d11-9a18-9a700bf9c100,host='devstack@QuobyteHD#QuobyteHD',id=db1e7f3e-8d87-4d15-8131-5d4d3f6680e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea3940f09f42909d3ffbcbd8e34b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:24Z,use_quota=True,user_id='d31ac8f852f04acc81c29483dc382669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6879644-751a-4919-9e66-7b9738f44c74),volume_type_id=a6879644-751a-4919-9e66-7b9738f44c74)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Creating volume db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:30 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:30 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 1073741824 Sep 11 23:07:30 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fbd7e5-369f-4735-b1b8-719261161a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac', 'volume_size': 1, 'snapshot_id': 'd86bbdc9-940a-4898-85e1-75aaadd38ab1'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188fd16a-4e7a-431b-9f01-e9f3a148fb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Volume volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac (52930c37-5727-4ff7-aad5-4f2bf03a5aac): created successfully Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188fd16a-4e7a-431b-9f01-e9f3a148fb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Flow 'volume_create_manager' (d11d3c57-c878-41cd-926a-cb38373eba0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e1abcce5-686c-46e5-8d85-3b05d9422222 tempest-VolumesDeleteCascade-1728778968 None] Created volume successfully. Sep 11 23:07:30 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 1073741824" returned: 0 in 0.411s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:30 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 Sep 11 23:07:30 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:30 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" returned: 0 in 0.258s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a222f4c-aa58-42d7-ae6c-3db8b6fb7c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b4c8e3-02ff-4e89-96c6-2a2f8ef591d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Volume volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 (db1e7f3e-8d87-4d15-8131-5d4d3f6680e5): created successfully Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b4c8e3-02ff-4e89-96c6-2a2f8ef591d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Flow 'volume_create_manager' (073845aa-325e-4e87-a449-005e67a51ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e1bd396f-2cbc-4b4a-9702-7b29dfa4ee2d tempest-GroupSnapshotsTest-1064308120 None] Created volume successfully. Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Flow 'volume_create_manager' (ece29039-6220-4218-8deb-5ccfbf7f0918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556837d8-2721-46ab-ae65-8c240cd2a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556837d8-2721-46ab-ae65-8c240cd2a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366597221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f984e05-38fc-49ea-a412-a3960e773f1d,host='devstack@QuobyteHD#QuobyteHD',id=c975b0e5-ff23-46bf-9e9f-2ef065b762f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9614cb3bbc96451689face91c67ce774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:31Z,use_quota=True,user_id='f5817545d67945e5b10a14b9d87fb5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e19566d6-9db4-47db-b092-da11056960c2),volume_type_id=e19566d6-9db4-47db-b092-da11056960c2)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ed3491-4db7-46b6-827d-6ffac3d66507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ed3491-4db7-46b6-827d-6ffac3d66507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a1b527-afd3-471e-a433-e6102df7718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a1b527-afd3-471e-a433-e6102df7718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c975b0e5-ff23-46bf-9e9f-2ef065b762f1', 'volume_name': 'volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7697d87-6116-43de-b328-3a0c984b31ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7697d87-6116-43de-b328-3a0c984b31ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7a9b6c-7433-4934-a792-bbb215fa5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Volume c975b0e5-ff23-46bf-9e9f-2ef065b762f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1', 'volume_size': 1} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f984e05-38fc-49ea-a412-a3960e773f1d,created_at=2026-09-11T21:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366597221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f984e05-38fc-49ea-a412-a3960e773f1d,host='devstack@QuobyteHD#QuobyteHD',id=c975b0e5-ff23-46bf-9e9f-2ef065b762f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9614cb3bbc96451689face91c67ce774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:31Z,use_quota=True,user_id='f5817545d67945e5b10a14b9d87fb5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e19566d6-9db4-47db-b092-da11056960c2),volume_type_id=e19566d6-9db4-47db-b092-da11056960c2)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Creating volume c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:31 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] GroupSnapshot a0ba76f6-132b-48d8-9c52-aca77c398ba9: creating. Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-ec9d21ed-e875-4b31-aa5d-5139bf913bfb-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 1073741824 Sep 11 23:07:31 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Group snapshot a0ba76f6-132b-48d8-9c52-aca77c398ba9: creating. {{(pid=88002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-ec9d21ed-e875-4b31-aa5d-5139bf913bfb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Performing cascade delete. {{(pid=88002) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-d86bbdc9-940a-4898-85e1-75aaadd38ab1-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-d86bbdc9-940a-4898-85e1-75aaadd38ab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-d86bbdc9-940a-4898-85e1-75aaadd38ab1" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-d86bbdc9-940a-4898-85e1-75aaadd38ab1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Deleting offline snapshot d86bbdc9-940a-4898-85e1-75aaadd38ab1 of volume ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] snapshot_file for this snap is: volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb406192-a15d-4d3b-91c0-85b6109539a7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:31 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 Sep 11 23:07:31 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 1073741824" returned: 0 in 0.529s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 Sep 11 23:07:32 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fa5fd6-9410-4323-95c6-e97c7df4adc1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb Sep 11 23:07:32 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" returned: 0 in 0.279s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.777s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7a9b6c-7433-4934-a792-bbb215fa5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600b71bc-4e0c-4be6-a3bb-f6fe79eab3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Creating offline snapshot 21456dec-01d1-424c-9e44-782a0b3bf5f8 of volume db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:32 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Volume volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 (c975b0e5-ff23-46bf-9e9f-2ef065b762f1): created successfully Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600b71bc-4e0c-4be6-a3bb-f6fe79eab3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Flow 'volume_create_manager' (ece29039-6220-4218-8deb-5ccfbf7f0918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7456197c-2ce5-48ad-9fe7-df09d8868b05]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-87676e26-dfa4-4b3c-b437-a40a08f774bc tempest-GroupsV314Test-1265378097 None] Created volume successfully. Sep 11 23:07:32 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 Sep 11 23:07:32 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Flow 'volume_create_manager' (1bc4c81e-0c09-4d0b-a11d-961a1b5268a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6318473d-bbdf-44a3-9925-35661109b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6318473d-bbdf-44a3-9925-35661109b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1437196616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331d31be-848b-4639-92aa-0e9b6a9f1b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf894dade4d4e7fa2b70a60aea994e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:33Z,use_quota=True,user_id='8e9b822d36cd420aa050505b09761ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e79e45-a53f-43ef-9bc9-f2356edb9e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e79e45-a53f-43ef-9bc9-f2356edb9e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f8fb48-6054-4edb-80fd-8d864328dec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f8fb48-6054-4edb-80fd-8d864328dec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331d31be-848b-4639-92aa-0e9b6a9f1b6b', 'volume_name': 'volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b06331-a9bf-486c-a01e-78b992525914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b06331-a9bf-486c-a01e-78b992525914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69938d49-ef8b-4e40-9e15-bcda92827f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:32 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Volume 331d31be-848b-4639-92aa-0e9b6a9f1b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b', 'volume_size': 1} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:32 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" returned: 0 in 0.626s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 Sep 11 23:07:32 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" returned: 0 in 0.440s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 1G Sep 11 23:07:32 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1" returned: 0 in 0.401s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1 Sep 11 23:07:33 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:33 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 1G" returned: 0 in 0.475s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 Sep 11 23:07:33 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb.d86bbdc9-940a-4898-85e1-75aaadd38ab1" returned: 0 in 0.285s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-d86bbdc9-940a-4898-85e1-75aaadd38ab1" released by "_delete_snapshot" :: held 1.839s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" released by "delete_snapshot" :: held 1.863s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Created reservations ['c8ae2edb-0894-4763-a3fb-3e005ad34318', '0ba5d5ee-098c-4fb4-82be-45ed9cead901', '1059a952-d8b1-427f-aa34-62e9a215f68b', '02b162bb-283f-4f3e-aa83-6cdf2a4c051d'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Delete snapshot completed successfully. Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-d86bbdc9-940a-4898-85e1-75aaadd38ab1-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Snapshots deleted, issuing volume delete {{(pid=88002) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:33 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8" returned: 0 in 0.320s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:33 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 Sep 11 23:07:33 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81b7a2-3ea5-44f3-8179-ff6c30a2a227]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb Sep 11 23:07:33 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8" returned: 0 in 0.283s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info Sep 11 23:07:34 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb Sep 11 23:07:34 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info" returned: 0 in 0.267s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info Sep 11 23:07:34 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" returned: 0 in 0.245s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-ec9d21ed-e875-4b31-aa5d-5139bf913bfb" released by "delete_volume" :: held 0.694s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Created reservations ['463fe40b-9343-4fd1-a1ed-770008e9560d', '249f9aec-5b25-4598-a870-3aab6c2bcb43', 'd16721f8-56e6-4c0f-9803-a123b445f11c', 'e577e00f-7ed0-45ce-b43f-61de14ed553c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:34 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.info" returned: 0 in 0.266s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1437196616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331d31be-848b-4639-92aa-0e9b6a9f1b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf894dade4d4e7fa2b70a60aea994e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:33Z,use_quota=True,user_id='8e9b822d36cd420aa050505b09761ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Creating volume 331d31be-848b-4639-92aa-0e9b6a9f1b6b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:34 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b 1073741824 Sep 11 23:07:34 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e339ad65-0a15-4afd-91b4-f03c64d182af tempest-GroupSnapshotsTest-1064308120 None] group_snapshot a0ba76f6-132b-48d8-9c52-aca77c398ba9: created successfully Sep 11 23:07:34 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.282s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Deleted volume successfully. Sep 11 23:07:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8994d1b9-bb0b-4d7f-9827-8ace5d7d0e25 tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-ec9d21ed-e875-4b31-aa5d-5139bf913bfb-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot a0ba76f6-132b-48d8-9c52-aca77c398ba9: deleting Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot a0ba76f6-132b-48d8-9c52-aca77c398ba9: deleting {{(pid=88002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-21456dec-01d1-424c-9e44-782a0b3bf5f8" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-21456dec-01d1-424c-9e44-782a0b3bf5f8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Deleting offline snapshot 21456dec-01d1-424c-9e44-782a0b3bf5f8 of volume db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] snapshot_file for this snap is: volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-52930c37-5727-4ff7-aad5-4f2bf03a5aac-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3bdfcb-9dfa-4942-82ec-7079f5058fac]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-52930c37-5727-4ff7-aad5-4f2bf03a5aac-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:35 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "cinder-quobyte-52930c37-5727-4ff7-aad5-4f2bf03a5aac" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b 1073741824" returned: 0 in 0.593s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-52930c37-5727-4ff7-aad5-4f2bf03a5aac" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff2a69-aca4-4b53-9801-1719075a1e30]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:35 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b Sep 11 23:07:35 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac Sep 11 23:07:35 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8" returned: 0 in 0.397s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:35 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b" returned: 0 in 0.261s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.194s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:35 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Cloning volume c975b0e5-ff23-46bf-9e9f-2ef065b762f1 to volume 4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87a514d-261c-4255-b45c-fd1d04a3d0c7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69938d49-ef8b-4e40-9e15-bcda92827f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a387e5d9-f07f-4626-a0ea-3508244ee822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Volume volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b (331d31be-848b-4639-92aa-0e9b6a9f1b6b): created successfully Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a387e5d9-f07f-4626-a0ea-3508244ee822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Flow 'volume_create_manager' (1bc4c81e-0c09-4d0b-a11d-961a1b5268a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Creating offline snapshot 0dec791b-44cc-4f93-a068-b95b60dcd35f of volume c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8abd2fae-119b-48f9-8912-16cf58eae72c tempest-AbsoluteLimitsTests-361786983 None] Created volume successfully. Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c173b1-b626-48ec-a9a2-a44b105010f4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac" returned: 0 in 0.417s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 Sep 11 23:07:35 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac Sep 11 23:07:35 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 Sep 11 23:07:35 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-52930c37-5727-4ff7-aad5-4f2bf03a5aac" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-quobyte-52930c37-5727-4ff7-aad5-4f2bf03a5aac" released by "delete_volume" :: held 0.737s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:36 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" returned: 0 in 0.472s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Created reservations ['2f614b73-c147-430f-b750-3850e923855b', '0284054b-5a2c-448b-bfdb-5d1cdf0bffc6', '66adf23e-4527-46c4-8522-46c9f912a522', '22d3ade8-452a-4c16-acb9-bfd288d52f58'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:36 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Acquiring lock "cinder-331d31be-848b-4639-92aa-0e9b6a9f1b6b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:36 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Lock "cinder-331d31be-848b-4639-92aa-0e9b6a9f1b6b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f 1G Sep 11 23:07:36 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Acquiring lock "cinder-quobyte-331d31be-848b-4639-92aa-0e9b6a9f1b6b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Lock "cinder-quobyte-331d31be-848b-4639-92aa-0e9b6a9f1b6b" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:36 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:36 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa3193-f6fd-49fc-8fe1-4ee6daaba51a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b Sep 11 23:07:36 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8" returned: 0 in 0.503s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8 Sep 11 23:07:36 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Deleted volume successfully. Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-75464b40-e2f9-4d9b-a90d-f27366c14b7b tempest-VolumesDeleteCascade-1728778968 None] Lock "cinder-52930c37-5727-4ff7-aad5-4f2bf03a5aac-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:36 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f 1G" returned: 0 in 0.526s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f Sep 11 23:07:36 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b" returned: 0 in 0.466s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b Sep 11 23:07:36 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5.21456dec-01d1-424c-9e44-782a0b3bf5f8" returned: 0 in 0.317s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-21456dec-01d1-424c-9e44-782a0b3bf5f8" released by "_delete_snapshot" :: held 1.817s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" released by "delete_snapshot" :: held 1.846s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:36 devstack cinder-volume[88002]: WARNING cinder.quota [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-776738642 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-776738642, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:36 devstack cinder-volume[88002]: WARNING cinder.quota [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-776738642 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-776738642, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['dfddbddf-7afe-4b5c-873b-96a7eca2a67d', '1ff5a1b5-0cb0-419d-b08b-6e61efb98324', '91ecd52c-58e6-4339-9c60-5ffb3277ea01', '055e65ca-9b03-434e-8e86-95ceedded6a6'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:37 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f" returned: 0 in 0.404s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2c17d615-540d-414b-91f4-4194346b2249 tempest-GroupSnapshotsTest-1064308120 None] group_snapshot a0ba76f6-132b-48d8-9c52-aca77c398ba9: deleted successfully Sep 11 23:07:37 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-331d31be-848b-4639-92aa-0e9b6a9f1b6b" returned: 0 in 0.312s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f Sep 11 23:07:37 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Lock "cinder-quobyte-331d31be-848b-4639-92aa-0e9b6a9f1b6b" released by "delete_volume" :: held 0.863s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Created reservations ['7cb517f2-d98a-4bc5-ab38-6dc39d444e26', '0b3b1bce-f121-4daf-b2be-915b61f603cb', '3db146b2-eebd-4ed8-901b-898d7ab8022c', '020cc682-9200-4abe-9d71-8fb6f91da9d6'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:37 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f" returned: 0 in 0.360s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info Sep 11 23:07:37 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.381s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Deleted volume successfully. Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-734eae4a-6133-4db2-af53-67b3fb03eae7 tempest-AbsoluteLimitsTests-361786983 None] Lock "cinder-331d31be-848b-4639-92aa-0e9b6a9f1b6b-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "cinder-quobyte-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:37 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info" returned: 0 in 0.437s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[22343a7b-243a-49bf-8d70-e90455d432fc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info Sep 11 23:07:37 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:38 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 Sep 11 23:07:38 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:38 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.info" returned: 0 in 0.369s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Acquiring lock "cinder-quobyte-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] snapshot: 0dec791b-44cc-4f93-a068-b95b60dcd35f, volume: 4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7558052a-b273-4c08-ba88-61b2a05281b0]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:38 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" returned: 0 in 0.607s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:38 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f Sep 11 23:07:38 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:38 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5 Sep 11 23:07:38 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:38 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Lock "cinder-quobyte-db1e7f3e-8d87-4d15-8131-5d4d3f6680e5" released by "delete_volume" :: held 0.966s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:38 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f" returned: 0 in 0.428s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d05a42-bd19-464d-ae3d-440da1632a10]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['51538cc1-07a1-427d-884a-c9c926e16886'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:38 devstack cinder-volume[88002]: WARNING cinder.quota [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-776738642 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-776738642, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:38 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Created reservations ['71ec02b9-99d8-4f95-b15b-565afe9963b9', '0c42e464-ce18-4e3e-9309-097e4f4acf2b', 'a713fc5c-bccf-4801-aa70-d758159ed287', 'fb581321-87fd-4066-91d9-2ef775c9f264'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:39 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 Sep 11 23:07:39 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:39 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:39 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:39 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" returned: 0 in 0.517s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:39 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:39 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:39 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 Sep 11 23:07:39 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dd37c78c-743b-4cce-b954-6c4235879c92 tempest-GroupSnapshotsTest-1064308120 None] Delete group completed successfully. Sep 11 23:07:45 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" returned: 0 in 5.623s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:07:45 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Converted 1024.00 MB image at 182.08 MB/s Sep 11 23:07:45 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:45 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 Sep 11 23:07:45 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:45 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" returned: 0 in 0.292s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" released by "_copy_volume_from_snapshot" :: held 6.996s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Acquiring lock "cinder-quobyte-0dec791b-44cc-4f93-a068-b95b60dcd35f" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-0dec791b-44cc-4f93-a068-b95b60dcd35f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Deleting offline snapshot 0dec791b-44cc-4f93-a068-b95b60dcd35f of volume c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] snapshot_file for this snap is: volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[13155c39-5b4b-4698-a99f-7d4e63db7001]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:45 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f Sep 11 23:07:45 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:45 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f" returned: 0 in 0.489s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0342a3f-7085-416f-baa7-0767f240383f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:46 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 Sep 11 23:07:46 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:46 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" returned: 0 in 0.685s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:46 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f Sep 11 23:07:46 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Flow 'volume_create_manager' (29875ba1-3e79-470c-8406-0c45dd2b12e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df57f25d-30ec-41e0-9fdc-cdd77ef21baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df57f25d-30ec-41e0-9fdc-cdd77ef21baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1203418125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5d680e-35a6-447b-86e3-ba4265f29123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d8e7edf7a44218a376dde63d890d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:47Z,use_quota=True,user_id='e831127562f24aa9abab21d48ff3656c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdebf9a6-2741-4fbb-b1e4-d15d49564bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdebf9a6-2741-4fbb-b1e4-d15d49564bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0895bb3-f4e9-4c88-b2c2-79ff0f6e3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0895bb3-f4e9-4c88-b2c2-79ff0f6e3ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5d680e-35a6-447b-86e3-ba4265f29123', 'volume_name': 'volume-ea5d680e-35a6-447b-86e3-ba4265f29123', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01b87c4-064b-4b7a-a5ec-fae229f8b30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01b87c4-064b-4b7a-a5ec-fae229f8b30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acc795c-072f-4cdb-9c19-316621392667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:46 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Volume ea5d680e-35a6-447b-86e3-ba4265f29123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5d680e-35a6-447b-86e3-ba4265f29123', 'volume_size': 1} Sep 11 23:07:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:47 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f" returned: 0 in 0.428s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:47 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f Sep 11 23:07:47 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:47 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1.0dec791b-44cc-4f93-a068-b95b60dcd35f" returned: 0 in 0.261s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-0dec791b-44cc-4f93-a068-b95b60dcd35f" released by "_delete_snapshot" :: held 1.981s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.867s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1203418125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5d680e-35a6-447b-86e3-ba4265f29123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d8e7edf7a44218a376dde63d890d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:47Z,use_quota=True,user_id='e831127562f24aa9abab21d48ff3656c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Creating volume ea5d680e-35a6-447b-86e3-ba4265f29123 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:47 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:47 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 1073741824 Sep 11 23:07:47 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Flow 'volume_create_manager' (a96f17df-3cf9-44e7-baef-a889ed6ecea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87859a15-f9af-4967-96d7-0c1c54015e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87859a15-f9af-4967-96d7-0c1c54015e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-292048351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6790ea7-73b1-4138-9c6e-3ddfa4e2e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a14b5d07734ad5bae6845f21aecad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:47Z,use_quota=True,user_id='4eca4ea825ca4bf6b4920c9b48d40f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a777f65-ea3a-4fc2-b018-89caed8f8a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a777f65-ea3a-4fc2-b018-89caed8f8a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa0946e-dd15-4ef9-b51c-61e44a8a8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa0946e-dd15-4ef9-b51c-61e44a8a8690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6790ea7-73b1-4138-9c6e-3ddfa4e2e824', 'volume_name': 'volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff201b0-3876-4b46-bd0d-2fc0974e6425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff201b0-3876-4b46-bd0d-2fc0974e6425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9291c83f-9552-45fb-96cd-834d14e6d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Volume b6790ea7-73b1-4138-9c6e-3ddfa4e2e824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824', 'volume_size': 1} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a5476c8e-2f63-47e8-a373-8514eb682ec2 tempest-GroupsV314Test-1265378097 None] Create group from source-group-1f984e05-38fc-49ea-a412-a3960e773f1d completed successfully. Sep 11 23:07:47 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 1073741824" returned: 0 in 0.460s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:47 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 Sep 11 23:07:47 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:48 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-292048351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6790ea7-73b1-4138-9c6e-3ddfa4e2e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a14b5d07734ad5bae6845f21aecad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:47Z,use_quota=True,user_id='4eca4ea825ca4bf6b4920c9b48d40f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Creating volume b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:48 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acc795c-072f-4cdb-9c19-316621392667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5d680e-35a6-447b-86e3-ba4265f29123', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 1073741824 Sep 11 23:07:48 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d94bbd1-70f5-463f-86c9-38d5c8118791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Volume volume-ea5d680e-35a6-447b-86e3-ba4265f29123 (ea5d680e-35a6-447b-86e3-ba4265f29123): created successfully Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d94bbd1-70f5-463f-86c9-38d5c8118791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Flow 'volume_create_manager' (29875ba1-3e79-470c-8406-0c45dd2b12e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4eb62df1-54af-4785-af64-87a1660259a8 tempest-VolumesTransfersV355Test-723331289 None] Created volume successfully. Sep 11 23:07:48 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 1073741824" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:48 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 Sep 11 23:07:48 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:48 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824" returned: 0 in 0.251s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9291c83f-9552-45fb-96cd-834d14e6d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52fa17f-cfea-478d-b9e5-fd923321781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Volume volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 (b6790ea7-73b1-4138-9c6e-3ddfa4e2e824): created successfully Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52fa17f-cfea-478d-b9e5-fd923321781b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Flow 'volume_create_manager' (a96f17df-3cf9-44e7-baef-a889ed6ecea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d7bbe538-adfb-4239-beb1-64bcb5b94d22 tempest-VolumesMetadataTest-954768145 None] Created volume successfully. Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Acquiring lock "cinder-quobyte-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[64043475-ae7c-47bf-b578-638617bec5ef]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 Sep 11 23:07:49 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bab1b569-8603-4109-af52-cfd84b4a58c9 tempest-GroupsV320Test-1906787336 None] Group tempest-GroupsV320Test-Group-213786124: creating Sep 11 23:07:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bab1b569-8603-4109-af52-cfd84b4a58c9 tempest-GroupsV320Test-1906787336 None] Group tempest-GroupsV320Test-Group-213786124: created successfully Sep 11 23:07:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bab1b569-8603-4109-af52-cfd84b4a58c9 tempest-GroupsV320Test-1906787336 None] Create group completed successfully. Sep 11 23:07:49 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" returned: 0 in 0.410s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0 Sep 11 23:07:49 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:49 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-4557b7af-0cb0-48b8-8b01-4e2dfe6ccde0" released by "delete_volume" :: held 0.760s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Created reservations ['878d133d-7828-4629-a502-f70809766906'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:50 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0020a6a9-1f0b-45ab-8e76-e22a5ae740a4 tempest-VolumesTransfersV355Test-1912063400 None] Transfer volume completed successfully. Sep 11 23:07:50 devstack cinder-volume[88002]: WARNING cinder.quota [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1848782679 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1848782679, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:50 devstack cinder-volume[88002]: WARNING cinder.quota [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1848782679 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1848782679, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Created reservations ['428bcf7d-b615-40db-ae31-b650c1c20c50', '09f6aa69-7ca3-4adb-af81-7e00260f4f08', '6aa199b0-4223-47dc-98ae-904e79156667', 'dc989002-a22b-49e7-8488-c4dba2cb09c4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:50 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:50 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Acquiring lock "cinder-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Lock "cinder-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Acquiring lock "cinder-quobyte-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Lock "cinder-quobyte-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6efc1ce-c2f3-40e8-9854-4aa913c6ba0b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:50 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:50 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 Sep 11 23:07:50 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.359s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:50 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7617d14e-76e3-4155-9c67-c94f18502e5e tempest-GroupsV314Test-1265378097 None] Delete group completed successfully. Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Acquiring lock "cinder-ea5d680e-35a6-447b-86e3-ba4265f29123-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-ea5d680e-35a6-447b-86e3-ba4265f29123-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Acquiring lock "cinder-quobyte-ea5d680e-35a6-447b-86e3-ba4265f29123" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-quobyte-ea5d680e-35a6-447b-86e3-ba4265f29123" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af43e5-557c-40d0-83f6-051cf0c5012f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 Sep 11 23:07:51 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824" returned: 0 in 0.549s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824 Sep 11 23:07:51 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Acquiring lock "cinder-quobyte-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" acquired by "delete_volume" :: waited 0.047s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d6ad10-720e-4f7e-a2ca-44e61121067e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Created reservations ['e2c10548-9af2-4565-b878-a79f7f695ab7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 Sep 11 23:07:51 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:51 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123" returned: 0 in 0.488s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123 Sep 11 23:07:51 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824" returned: 0 in 0.343s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Lock "cinder-quobyte-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824" released by "delete_volume" :: held 0.954s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Created reservations ['0d1f413c-aaf1-42d0-b57f-5bfc5a67b06b', 'd5772c8c-f6a2-4dc6-8739-43aced6db5b8', '9b036013-2db9-4b57-97b0-6acc9b51aa1b', 'f1890bae-a4cb-44ef-bd38-f598521e02da'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.258s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:51 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:51 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6926dbf9-07f1-4f71-b55a-0b540f5f282c tempest-GroupsV320Test-1906787336 None] Delete group completed successfully. Sep 11 23:07:51 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" returned: 0 in 0.459s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1 Sep 11 23:07:51 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea5d680e-35a6-447b-86e3-ba4265f29123" returned: 0 in 0.341s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-quobyte-ea5d680e-35a6-447b-86e3-ba4265f29123" released by "delete_volume" :: held 0.875s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Created reservations ['7d43af61-2d84-454f-8193-c2dbf331ed02', 'ee16fe48-a9a8-465f-a8c4-71788c3fd8a4', '22a62a35-b9ff-48ae-907f-8d6ab1971be9', '2e87a4ac-ce7d-4821-bd8b-288167e20784'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:51 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.296s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Deleted volume successfully. Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-02b4ecf9-1ceb-4354-b0d3-5f74b3c7e013 tempest-VolumesMetadataTest-954768145 None] Lock "cinder-b6790ea7-73b1-4138-9c6e-3ddfa4e2e824-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:51 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:51 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" returned: 0 in 0.285s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Lock "cinder-quobyte-c975b0e5-ff23-46bf-9e9f-2ef065b762f1" released by "delete_volume" :: held 0.807s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Created reservations ['b24fc5e1-588e-4380-b1e5-2a73308d3526'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Created reservations ['506175db-d8c0-443a-b82f-9f12496cffd4', 'ba987714-a1bc-4f72-a508-c22bd6e35d73', '8c6b5073-8003-4fd8-92fc-6a53c311a136', 'f7132608-7b33-4157-b6c1-45355a4b45da'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:52 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.346s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Deleted volume successfully. Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bdff0ecf-5c4e-44a6-aaa6-1f97c52cc14f tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-ea5d680e-35a6-447b-86e3-ba4265f29123-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:52 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:52 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:52 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dbed7d64-f840-4dd4-890e-4be9a87e9a4c tempest-GroupsV314Test-1265378097 None] Delete group completed successfully. Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Flow 'volume_create_manager' (0f3af408-60f4-49ca-85fc-913391de3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a5c9a1-9d2e-4373-bd62-169a9e182d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a5c9a1-9d2e-4373-bd62-169a9e182d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1406768573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f89911-5a62-4dab-b404-7e8cd9faac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d8e7edf7a44218a376dde63d890d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:53Z,use_quota=True,user_id='e831127562f24aa9abab21d48ff3656c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8987448-e8df-41d8-8108-2a4298725c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8987448-e8df-41d8-8108-2a4298725c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddc18d9-d08b-4618-9174-8ae2996e6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddc18d9-d08b-4618-9174-8ae2996e6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f89911-5a62-4dab-b404-7e8cd9faac72', 'volume_name': 'volume-16f89911-5a62-4dab-b404-7e8cd9faac72', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5cf089-7509-4195-a9a8-153d9ca7641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5cf089-7509-4195-a9a8-153d9ca7641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3033219-f7c5-435f-9533-48c313aa30e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:52 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Volume 16f89911-5a62-4dab-b404-7e8cd9faac72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f89911-5a62-4dab-b404-7e8cd9faac72', 'volume_size': 1} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1406768573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f89911-5a62-4dab-b404-7e8cd9faac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d8e7edf7a44218a376dde63d890d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:53Z,use_quota=True,user_id='e831127562f24aa9abab21d48ff3656c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Creating volume 16f89911-5a62-4dab-b404-7e8cd9faac72 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:52 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:07:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:52 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 1073741824 Sep 11 23:07:52 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:53 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 1073741824" returned: 0 in 0.552s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:53 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 Sep 11 23:07:53 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:53 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72" returned: 0 in 0.300s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3033219-f7c5-435f-9533-48c313aa30e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f89911-5a62-4dab-b404-7e8cd9faac72', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a3aae5-def4-40ba-b7ad-645e2832b733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:53 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Volume volume-16f89911-5a62-4dab-b404-7e8cd9faac72 (16f89911-5a62-4dab-b404-7e8cd9faac72): created successfully Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a3aae5-def4-40ba-b7ad-645e2832b733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Flow 'volume_create_manager' (0f3af408-60f4-49ca-85fc-913391de3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:53 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a7f450b4-d18f-40ee-823b-316deec9a90e tempest-VolumesTransfersV355Test-723331289 None] Created volume successfully. Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Acquiring lock "cinder-16f89911-5a62-4dab-b404-7e8cd9faac72-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-16f89911-5a62-4dab-b404-7e8cd9faac72-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Acquiring lock "cinder-quobyte-16f89911-5a62-4dab-b404-7e8cd9faac72" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-quobyte-16f89911-5a62-4dab-b404-7e8cd9faac72" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[db32337b-1a8d-428f-858d-9adc18d7faf8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:55 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 Sep 11 23:07:55 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:55 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72" returned: 0 in 0.459s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:55 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72 Sep 11 23:07:55 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:56 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-16f89911-5a62-4dab-b404-7e8cd9faac72" returned: 0 in 0.317s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-quobyte-16f89911-5a62-4dab-b404-7e8cd9faac72" released by "delete_volume" :: held 0.824s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Created reservations ['351a1072-1679-4f62-bdf0-2a2bea91a083', '92fdf07a-b027-4afe-8dc0-68002a52333f', '5117c15e-3a5e-456b-a5a6-95080ea0a815', '763ed3eb-5ebb-450a-86e4-234369d6f14b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:56 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:56 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:56 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.354s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Deleted volume successfully. Sep 11 23:07:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-80542c62-684f-46e7-824d-6d980ea3b818 tempest-VolumesTransfersV355Test-1856785615 None] Lock "cinder-16f89911-5a62-4dab-b404-7e8cd9faac72-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:59 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:07:59 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:59 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.299s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:07:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Flow 'volume_create_manager' (a2351540-92e1-42db-b6d9-01fbd6dda2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a809d96-f41e-4482-b5d9-addca1fd4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a809d96-f41e-4482-b5d9-addca1fd4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2027028131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2db91de-03e6-4ce3-a155-74311135e393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1b7563ab9e486696c463a788acedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:01Z,use_quota=True,user_id='d0e84e21e18a4f69a5418d468d32aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ecbb55-19de-4ac2-a7f2-8f8e554cab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ecbb55-19de-4ac2-a7f2-8f8e554cab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8ed203-730c-4421-9713-5f22766666c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8ed203-730c-4421-9713-5f22766666c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2db91de-03e6-4ce3-a155-74311135e393', 'volume_name': 'volume-b2db91de-03e6-4ce3-a155-74311135e393', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad42964-2078-472d-9445-a235170dc51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad42964-2078-472d-9445-a235170dc51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175a3aa8-4e50-434f-9442-891444f970a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Volume b2db91de-03e6-4ce3-a155-74311135e393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2db91de-03e6-4ce3-a155-74311135e393', 'volume_size': 1} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2027028131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2db91de-03e6-4ce3-a155-74311135e393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1b7563ab9e486696c463a788acedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:01Z,use_quota=True,user_id='d0e84e21e18a4f69a5418d468d32aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Creating volume b2db91de-03e6-4ce3-a155-74311135e393 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:01 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:01 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 1073741824 Sep 11 23:08:01 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:01 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 1073741824" returned: 0 in 0.572s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:01 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 Sep 11 23:08:01 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:02 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175a3aa8-4e50-434f-9442-891444f970a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2db91de-03e6-4ce3-a155-74311135e393', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa56808-3019-49d9-aa6c-4a9bc4f8078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Volume volume-b2db91de-03e6-4ce3-a155-74311135e393 (b2db91de-03e6-4ce3-a155-74311135e393): created successfully Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa56808-3019-49d9-aa6c-4a9bc4f8078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Flow 'volume_create_manager' (a2351540-92e1-42db-b6d9-01fbd6dda2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-472d7315-1eba-4e90-a108-83c2ff639a71 tempest-VolumesTransfersTest-953679989 None] Created volume successfully. Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Flow 'volume_create_manager' (e9314b32-7706-4fbb-9e8a-6bfa424eac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c5c3e5-dbf1-43e2-bef2-2d78c37538fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c5c3e5-dbf1-43e2-bef2-2d78c37538fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-972343604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acc8363-24c0-4047-aa64-ba53d409d5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d0afad0934dc992b289a429a92c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:02Z,use_quota=True,user_id='86f152b94d0f45059f00d2eca477a874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc03977-fc51-4329-b531-c2034f56257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc03977-fc51-4329-b531-c2034f56257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd09025-ba50-4731-b4a8-98e0da926415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd09025-ba50-4731-b4a8-98e0da926415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acc8363-24c0-4047-aa64-ba53d409d5ee', 'volume_name': 'volume-4acc8363-24c0-4047-aa64-ba53d409d5ee', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236d7d98-f192-4075-ae03-9326bf687237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236d7d98-f192-4075-ae03-9326bf687237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e56c55-a834-4f51-bef4-7c6d32880de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Volume 4acc8363-24c0-4047-aa64-ba53d409d5ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acc8363-24c0-4047-aa64-ba53d409d5ee', 'volume_size': 1} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-972343604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acc8363-24c0-4047-aa64-ba53d409d5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528d0afad0934dc992b289a429a92c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:02Z,use_quota=True,user_id='86f152b94d0f45059f00d2eca477a874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Creating volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:02 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:02 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee 1073741824 Sep 11 23:08:02 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:02 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee 1073741824" returned: 0 in 0.538s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:02 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee Sep 11 23:08:02 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:03 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee" returned: 0 in 0.342s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e56c55-a834-4f51-bef4-7c6d32880de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acc8363-24c0-4047-aa64-ba53d409d5ee', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94aaeffa-a336-49ee-9cfd-ec8f45669852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Volume volume-4acc8363-24c0-4047-aa64-ba53d409d5ee (4acc8363-24c0-4047-aa64-ba53d409d5ee): created successfully Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94aaeffa-a336-49ee-9cfd-ec8f45669852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Flow 'volume_create_manager' (e9314b32-7706-4fbb-9e8a-6bfa424eac6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5cb11f45-861c-4154-9ac9-92a6db9d89d4 tempest-SnapshotsActionsTest-936338479 None] Created volume successfully. Sep 11 23:08:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cedf9b43-b6c6-4a19-bbba-0d49733ef3f2 tempest-VolumesTransfersTest-1424141240 None] Transfer volume completed successfully. Sep 11 23:08:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Creating offline snapshot 10d390e1-befa-4523-a48f-e3d35ead0422 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[24231ce9-608f-442a-9ba5-9e5803a5307f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:04 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee Sep 11 23:08:04 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:05 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee" returned: 0 in 0.478s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:05 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 1G Sep 11 23:08:05 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Acquiring lock "cinder-b2db91de-03e6-4ce3-a155-74311135e393-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-b2db91de-03e6-4ce3-a155-74311135e393-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Acquiring lock "cinder-quobyte-b2db91de-03e6-4ce3-a155-74311135e393" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-quobyte-b2db91de-03e6-4ce3-a155-74311135e393" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff6707-b521-4fdd-b976-4e02697c4394]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:05 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 Sep 11 23:08:05 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:05 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 1G" returned: 0 in 0.622s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:05 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:05 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:06 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393" returned: 0 in 0.491s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:06 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393 Sep 11 23:08:06 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:06 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:06 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 is being set with open permissions: ugo+rw Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:06 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:06 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:06 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b2db91de-03e6-4ce3-a155-74311135e393" returned: 0 in 0.308s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-quobyte-b2db91de-03e6-4ce3-a155-74311135e393" released by "delete_volume" :: held 0.854s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Created reservations ['81cf73ea-739f-4b9f-9999-2eb134090e29', '916c17a6-4606-4ab8-b09c-6f39bc5bbc60', 'aa230350-a09f-4601-93af-4f1e15e460b7', 'b04d80c3-e5e6-47dd-8c76-d30e3e6288f4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:06 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:08:06 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:06 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:06 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info Sep 11 23:08:06 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:06 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.449s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:06 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Deleted volume successfully. Sep 11 23:08:07 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-74556206-3a89-4df4-b870-a5dd79581400 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-b2db91de-03e6-4ce3-a155-74311135e393-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info" returned: 0 in 0.355s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:07 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info is being set with open permissions: ugo+rw Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:07 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info Sep 11 23:08:07 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:07 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.info" returned: 0 in 0.310s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Flow 'volume_create_manager' (27f5d0ba-f34c-4743-bcbc-321b48e14e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916f8fb5-f1d1-4096-a079-91a44dba3eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-13284c21-c33a-4195-82d8-4b536489a7e5 tempest-SnapshotsActionsTest-936338479 None] Create snapshot completed successfully Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916f8fb5-f1d1-4096-a079-91a44dba3eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1825300605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5421a90d-52ab-41f2-8f8a-f513982efc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1b7563ab9e486696c463a788acedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:07Z,use_quota=True,user_id='d0e84e21e18a4f69a5418d468d32aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2437dc9-211b-4304-b325-2994fcaaabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2437dc9-211b-4304-b325-2994fcaaabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99be05ec-cb02-4fd3-b128-8e5f9bdcfed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99be05ec-cb02-4fd3-b128-8e5f9bdcfed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5421a90d-52ab-41f2-8f8a-f513982efc92', 'volume_name': 'volume-5421a90d-52ab-41f2-8f8a-f513982efc92', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4911e5-1700-41cb-a3d3-07ee67a37e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4911e5-1700-41cb-a3d3-07ee67a37e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149f160a-928e-4473-9920-9e099da1eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:07 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Volume 5421a90d-52ab-41f2-8f8a-f513982efc92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5421a90d-52ab-41f2-8f8a-f513982efc92', 'volume_size': 1} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1825300605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5421a90d-52ab-41f2-8f8a-f513982efc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1b7563ab9e486696c463a788acedb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:07Z,use_quota=True,user_id='d0e84e21e18a4f69a5418d468d32aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Creating volume 5421a90d-52ab-41f2-8f8a-f513982efc92 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:07 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:08:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:07 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 1073741824 Sep 11 23:08:07 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:08 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 1073741824" returned: 0 in 0.539s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:08 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 Sep 11 23:08:08 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:08 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92" returned: 0 in 0.328s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149f160a-928e-4473-9920-9e099da1eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5421a90d-52ab-41f2-8f8a-f513982efc92', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a1ffda-e237-483c-92ae-efef4b61631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Volume volume-5421a90d-52ab-41f2-8f8a-f513982efc92 (5421a90d-52ab-41f2-8f8a-f513982efc92): created successfully Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a1ffda-e237-483c-92ae-efef4b61631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Flow 'volume_create_manager' (27f5d0ba-f34c-4743-bcbc-321b48e14e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bf60d529-894e-43d8-8144-f80ebb209ab6 tempest-VolumesTransfersTest-953679989 None] Created volume successfully. Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Creating offline snapshot 02429177-a4d5-46e5-8203-c14d192a8560 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c44611e-5334-4ca4-8151-08a4cba496bc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:08 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:08 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:09 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.397s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:09 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 1G Sep 11 23:08:09 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:09 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 1G" returned: 0 in 0.498s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:09 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 Sep 11 23:08:09 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Acquiring lock "cinder-5421a90d-52ab-41f2-8f8a-f513982efc92-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-5421a90d-52ab-41f2-8f8a-f513982efc92-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Acquiring lock "cinder-quobyte-5421a90d-52ab-41f2-8f8a-f513982efc92" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-quobyte-5421a90d-52ab-41f2-8f8a-f513982efc92" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a80f95-3cf2-4f18-83a9-ed6cc511de49]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:10 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560" returned: 0 in 0.543s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:10 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 is being set with open permissions: ugo+rw Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:10 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 Sep 11 23:08:10 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:10 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 Sep 11 23:08:10 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:10 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560" returned: 0 in 0.263s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3b87dd53-049d-4c08-872d-b9b217bd459e tempest-SnapshotsActionsTest-936338479 None] Create snapshot completed successfully Sep 11 23:08:10 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92" returned: 0 in 0.447s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:10 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92 Sep 11 23:08:10 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:10 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5421a90d-52ab-41f2-8f8a-f513982efc92" returned: 0 in 0.287s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-quobyte-5421a90d-52ab-41f2-8f8a-f513982efc92" released by "delete_volume" :: held 0.786s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-02429177-a4d5-46e5-8203-c14d192a8560-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-02429177-a4d5-46e5-8203-c14d192a8560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-02429177-a4d5-46e5-8203-c14d192a8560" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Created reservations ['362f0a23-e1a6-4fe7-8cc4-7a4e1f0eec47', '57f37256-b935-4105-a281-5cbd2b8a3686', 'd198586f-8341-4c1f-b2a2-99874e73e4a7', 'ea35e822-4131-4e0b-98d5-c99eac809cab'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-02429177-a4d5-46e5-8203-c14d192a8560" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Deleting offline snapshot 02429177-a4d5-46e5-8203-c14d192a8560 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] snapshot_file for this snap is: volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[590a9ecb-d633-4913-a717-c21e8c5a1abc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:11 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:08:11 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:11 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 Sep 11 23:08:11 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:11 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Deleted volume successfully. Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eae96eb2-080b-458a-b1a7-28cc2e4d26e7 tempest-VolumesTransfersTest-1403876254 None] Lock "cinder-5421a90d-52ab-41f2-8f8a-f513982efc92-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:11 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560" returned: 0 in 0.567s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[273715a3-037c-462e-87cc-f3ddaa898dce]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:11 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:11 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:11 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Flow 'volume_create_manager' (b0029a9f-9201-4c9c-b193-3c461bb89f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d206fd-5303-454b-bcb6-88e367285b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d206fd-5303-454b-bcb6-88e367285b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1981836187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9b6990416240aebe8c0c63e0cf6b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:12Z,use_quota=True,user_id='4167883dca364d7597fc03e08655aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a917de-4c8c-471c-a3ad-77fc1afc1ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a917de-4c8c-471c-a3ad-77fc1afc1ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7bd411-56fe-43fd-88b4-50ac5fb3e2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7bd411-56fe-43fd-88b4-50ac5fb3e2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c', 'volume_name': 'volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a49b43-7a20-4df3-8e61-758853fce12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a49b43-7a20-4df3-8e61-758853fce12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d380669-5668-4b37-b1a7-c29f24ad43f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Volume 0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c', 'volume_size': 1} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1981836187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9b6990416240aebe8c0c63e0cf6b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:12Z,use_quota=True,user_id='4167883dca364d7597fc03e08655aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Creating volume 0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:12 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:12 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.490s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:12 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c 1073741824 Sep 11 23:08:12 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:12 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 Sep 11 23:08:12 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:12 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560" returned: 0 in 0.431s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:12 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560 Sep 11 23:08:12 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:12 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c 1073741824" returned: 0 in 0.520s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:12 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c Sep 11 23:08:12 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:12 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.02429177-a4d5-46e5-8203-c14d192a8560" returned: 0 in 0.270s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-02429177-a4d5-46e5-8203-c14d192a8560" released by "_delete_snapshot" :: held 1.903s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" released by "delete_snapshot" :: held 1.938s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:12 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Created reservations ['e0e8fc79-bb38-46e0-ba29-7d74374da90b', 'ac6f26ef-acd0-4603-81ab-bd722e984524', '7f1fd2dc-c9d0-460e-8ac9-81120f0dfe31', 'ecd27f6d-da28-4307-b7ce-c7d257beb749'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Delete snapshot completed successfully. Sep 11 23:08:13 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6f4f9a0-d212-4b9b-b945-a130a056dc6d tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-02429177-a4d5-46e5-8203-c14d192a8560-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c" returned: 0 in 0.379s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d380669-5668-4b37-b1a7-c29f24ad43f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62576e23-ddf5-49ba-97d6-ffb53f654bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Volume volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c (0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c): created successfully Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62576e23-ddf5-49ba-97d6-ffb53f654bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Flow 'volume_create_manager' (b0029a9f-9201-4c9c-b193-3c461bb89f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c57076d9-865b-4d8d-8c89-4d74a20c2720 tempest-VolumeQuotasNegativeTestJSON-901976366 None] Created volume successfully. Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Creating offline snapshot 546062f9-7d1e-48b0-bf29-73cf29dc5a67 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[686d338f-ca98-45d3-83b1-fb6e5ad153a1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:13 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:13 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:13 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.414s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:13 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 1G Sep 11 23:08:13 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:14 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 1G" returned: 0 in 0.608s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:14 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 Sep 11 23:08:14 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:14 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:14 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 is being set with open permissions: ugo+rw Sep 11 23:08:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:14 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 Sep 11 23:08:14 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:15 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67" returned: 0 in 0.389s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Acquiring lock "cinder-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "cinder-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7c584665-ffba-4021-9178-d49bd9e2a95b tempest-SnapshotsActionsTest-936338479 None] Create snapshot completed successfully Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Acquiring lock "cinder-quobyte-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "cinder-quobyte-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe2f8f8-57df-4620-b261-47d1d58024e6]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:15 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c Sep 11 23:08:15 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-546062f9-7d1e-48b0-bf29-73cf29dc5a67-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-546062f9-7d1e-48b0-bf29-73cf29dc5a67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-546062f9-7d1e-48b0-bf29-73cf29dc5a67" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-546062f9-7d1e-48b0-bf29-73cf29dc5a67" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Deleting offline snapshot 546062f9-7d1e-48b0-bf29-73cf29dc5a67 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] snapshot_file for this snap is: volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[58460f7e-b221-4fae-89e7-74c3f6287bc2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:16 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c" returned: 0 in 0.506s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:16 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c Sep 11 23:08:16 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:16 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 Sep 11 23:08:16 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:16 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "cinder-quobyte-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c" released by "delete_volume" :: held 0.895s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Created reservations ['c91ddcf8-8886-4eb5-8de5-d8baf80a58d1', '1dcdbcc3-40dc-4e88-8804-a7db51a75e9a', 'f41b565a-9c47-4e86-ae6f-c2fecfd97ec0', '0f23bfe1-22e3-4456-b5b2-8663062dbca1'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:16 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67" returned: 0 in 0.544s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3991fd60-849f-48f6-90d0-dd4a1868bac5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:16 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:08:16 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:16 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:16 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:16 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.477s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:17 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.416s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:17 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 Sep 11 23:08:17 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Deleted volume successfully. Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-30d83443-259d-4273-898a-e0063cb00a3c tempest-VolumeQuotasNegativeTestJSON-901976366 None] Lock "cinder-0e2e6f68-1f2d-433a-90e7-cf67a9abaf6c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:17 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67" returned: 0 in 0.519s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:17 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67 Sep 11 23:08:17 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:17 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.546062f9-7d1e-48b0-bf29-73cf29dc5a67" returned: 0 in 0.334s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-546062f9-7d1e-48b0-bf29-73cf29dc5a67" released by "_delete_snapshot" :: held 2.015s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" released by "delete_snapshot" :: held 2.069s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:18 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Created reservations ['5246fce1-47cb-4012-86fc-bbfd5083fe42', 'ab4fa419-c1c4-45a1-a21b-a0029e8c2633', 'f28762b2-6f77-4a81-a7e2-3299bc398a61', '5e43da1d-d8f7-4666-b1fd-5751ec7447d6'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Delete snapshot completed successfully. Sep 11 23:08:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f310ce9e-1f1c-49cd-9b4f-48b884189bf7 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-546062f9-7d1e-48b0-bf29-73cf29dc5a67-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Creating offline snapshot a83f83a1-b4ef-4995-a871-40c12b726099 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b9fc1-474d-4bfc-80d3-3c08f161f5a1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:19 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:19 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:19 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.446s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:19 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 1G Sep 11 23:08:19 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:20 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 1G" returned: 0 in 0.520s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:20 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 Sep 11 23:08:20 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:20 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 is being set with open permissions: ugo+rw Sep 11 23:08:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:20 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 Sep 11 23:08:20 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:21 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.692s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7cc73fdf-a189-4c99-828d-215883fe6113 tempest-SnapshotsActionsTest-936338479 None] Create snapshot completed successfully Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-a83f83a1-b4ef-4995-a871-40c12b726099-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-a83f83a1-b4ef-4995-a871-40c12b726099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-a83f83a1-b4ef-4995-a871-40c12b726099" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-a83f83a1-b4ef-4995-a871-40c12b726099" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Deleting offline snapshot a83f83a1-b4ef-4995-a871-40c12b726099 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] snapshot_file for this snap is: volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c05173-5157-4d97-b513-cb3a8b7ef199]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:21 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 Sep 11 23:08:21 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:22 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099" returned: 0 in 0.453s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c816d2ee-e05c-4121-a64f-94fc8062f5d5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:22 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:22 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:22 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.420s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:22 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 Sep 11 23:08:22 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:23 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099" returned: 0 in 0.421s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:23 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099 Sep 11 23:08:23 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:23 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.a83f83a1-b4ef-4995-a871-40c12b726099" returned: 0 in 0.292s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-a83f83a1-b4ef-4995-a871-40c12b726099" released by "_delete_snapshot" :: held 1.706s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" released by "delete_snapshot" :: held 1.737s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Created reservations ['bb9820a5-b9df-4510-bc63-21e085b06352', '075a99a5-d1d0-414e-a53f-ade1b5196fd1', '76566d5a-b8d2-477c-b72f-0f78f572ea93', '2e814320-33e6-4de1-97ab-24884beb1335'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Delete snapshot completed successfully. Sep 11 23:08:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1033e01f-ca7a-4d0e-877f-624ded394913 tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-a83f83a1-b4ef-4995-a871-40c12b726099-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Creating offline snapshot d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12e234-567f-444e-b69b-1721d1d22683]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:24 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:24 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:24 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.467s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:24 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 1G Sep 11 23:08:24 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:25 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 1G" returned: 0 in 0.585s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:25 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 Sep 11 23:08:25 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:25 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 is being set with open permissions: ugo+rw Sep 11 23:08:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:25 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 Sep 11 23:08:25 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:25 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" returned: 0 in 0.276s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:26 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-244107a0-6162-4dd6-95f8-e3383cb4c744 tempest-SnapshotsActionsTest-936338479 None] Create snapshot completed successfully Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Acquiring lock "cinder-quobyte-d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Deleting offline snapshot d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] snapshot_file for this snap is: volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60442ef-fc02-4039-9c14-9578f6cbe6af]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:26 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 Sep 11 23:08:26 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:27 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" returned: 0 in 0.500s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b0ba5a-ec13-46b6-a032-f8981a31917a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:27 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:27 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:27 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:27 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 Sep 11 23:08:27 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:28 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" returned: 0 in 0.531s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:28 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993 Sep 11 23:08:28 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:28 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" returned: 0 in 0.446s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993" released by "_delete_snapshot" :: held 2.146s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" released by "delete_snapshot" :: held 2.181s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Created reservations ['af8f13bf-6b00-43b5-adf6-333bd47944a3', 'f3f6a82a-80eb-4cf0-b19b-f54d5e89d53e', '0285afc1-436b-4d68-9858-54a447e72d5a', 'f502b6b3-331d-494d-86a2-0c5b1b9084db'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Delete snapshot completed successfully. Sep 11 23:08:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-107fd918-e5d4-43d5-a8c4-1520c591b5ca tempest-SnapshotsActionsTest-942716010 None] Lock "cinder-d55ba6e1-d1f2-4ba0-99d2-6e4ac26a7993-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "cinder-10d390e1-befa-4523-a48f-e3d35ead0422-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-10d390e1-befa-4523-a48f-e3d35ead0422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "cinder-quobyte-10d390e1-befa-4523-a48f-e3d35ead0422" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-quobyte-10d390e1-befa-4523-a48f-e3d35ead0422" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Deleting offline snapshot 10d390e1-befa-4523-a48f-e3d35ead0422 of volume 4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] snapshot_file for this snap is: volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0d3ef-2224-4941-be40-6eeea3758c42]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:30 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:30 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:31 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.596s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4acc8363-24c0-4047-aa64-ba53d409d5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbeac3d-6488-4988-80d4-89a79e68b57e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:31 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee Sep 11 23:08:31 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:31 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee" returned: 0 in 0.535s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:31 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:31 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:32 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.474s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:32 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422 Sep 11 23:08:32 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=188,cinder:SELECT=159,cinder:INSERT=45,cinder:DELETE=11 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=152,cinder:UPDATE=184,cinder:DELETE=14,cinder:INSERT=46 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Flow 'volume_create_manager' (5fb913d2-ccf2-421b-842e-b6e9d1acf52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68a5b92-d823-4c51-a29c-a77d27deb8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68a5b92-d823-4c51-a29c-a77d27deb8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-608682440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b579755-fb5d-4039-96c9-282f5fa4cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22934ab0a384e3e9fcfa745f7fc64c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:32Z,use_quota=True,user_id='3dc138678a4848b18e67bc16b85b655c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b542de21-9381-406b-8f15-77c5f70a960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b542de21-9381-406b-8f15-77c5f70a960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8be57a-06f0-4c3a-bd46-6efa48e3ca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:08:32 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee.10d390e1-befa-4523-a48f-e3d35ead0422" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-quobyte-10d390e1-befa-4523-a48f-e3d35ead0422" released by "_delete_snapshot" :: held 2.099s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" released by "delete_snapshot" :: held 2.138s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Created reservations ['2400c9f4-f4a2-4680-b4f6-acd135960bff', '75f65380-e2f4-498c-9dc5-5d38a36269d2', 'd13281d0-c976-4fae-bcd2-2d48be85f1a6', '52a2a367-d91b-4cb7-9cb1-6e5e3be7b6e7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Delete snapshot completed successfully. Sep 11 23:08:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e6afedfa-7635-4aad-9fa5-663a304ca840 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-10d390e1-befa-4523-a48f-e3d35ead0422-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8be57a-06f0-4c3a-bd46-6efa48e3ca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b579755-fb5d-4039-96c9-282f5fa4cb3d', 'volume_name': 'volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38a7eb-1bf2-4831-a129-637e61303f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38a7eb-1bf2-4831-a129-637e61303f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f949e090-96f0-44d6-b78f-2bd59db3ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:33 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Volume 4b579755-fb5d-4039-96c9-282f5fa4cb3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Trying to clone 4b579755-fb5d-4039-96c9-282f5fa4cb3d from image 1baacf90-ac97-495c-951c-132c1ebb83be at location (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:08:33 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[db23efae-f56d-43d3-9b3f-433a2097595c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:33 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD Sep 11 23:08:33 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "cinder-4acc8363-24c0-4047-aa64-ba53d409d5ee-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-4acc8363-24c0-4047-aa64-ba53d409d5ee-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[93637f77-2608-4278-94e0-522ae4dc0c97]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:34 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be is fetched for user 3dc138678a4848b18e67bc16b85b655c. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:08:34 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee Sep 11 23:08:34 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62e8255-dc10-487f-99f7-5ba457914522]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:34 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD Sep 11 23:08:34 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:34 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee" returned: 0 in 0.428s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:34 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee Sep 11 23:08:34 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:34 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-608682440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b579755-fb5d-4039-96c9-282f5fa4cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22934ab0a384e3e9fcfa745f7fc64c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:32Z,use_quota=True,user_id='3dc138678a4848b18e67bc16b85b655c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Creating volume 4b579755-fb5d-4039-96c9-282f5fa4cb3d {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:34 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:34 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d 1073741824 Sep 11 23:08:34 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:34 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4acc8363-24c0-4047-aa64-ba53d409d5ee" returned: 0 in 0.318s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-quobyte-4acc8363-24c0-4047-aa64-ba53d409d5ee" released by "delete_volume" :: held 0.861s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Created reservations ['bb2850c3-2e38-4e41-9de1-30fd75fa7d72', '77be72da-a1f0-47af-8d3d-5f14ec558905', '3f5b6256-b0df-4bf4-825d-1467b5b0d3c7', 'e7dbccc2-e5cc-41a6-bd2a-a93b767f311e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:34 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:08:34 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:35 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d 1073741824" returned: 0 in 0.792s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:35 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.519s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Deleted volume successfully. Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32b73dcc-a3be-48d8-a804-1e8a482caf14 tempest-SnapshotsActionsTest-936338479 None] Lock "cinder-4acc8363-24c0-4047-aa64-ba53d409d5ee-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:35 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d Sep 11 23:08:35 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:35 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d" returned: 0 in 0.426s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:35 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Attempting download of 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 4b579755-fb5d-4039-96c9-282f5fa4cb3d. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:08:36 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb728dd-4eb9-40be-8df3-9d20822b46cf]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_ {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:36 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_ Sep 11 23:08:36 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:36 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_" returned: 0 in 0.432s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_ {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:36 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_ Sep 11 23:08:36 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:37 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_" returned: 1 in 0.498s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_46tgln7_' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f113a7b6-f8a1-457e-a983-4efa8ee4cbf8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Flow 'volume_create_manager' (62ed5dce-c565-4145-9c95-bb44af16e15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9befcccc-2b9f-4c74-bcbf-54235623ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9befcccc-2b9f-4c74-bcbf-54235623ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-473426088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abf1ac8-163e-482a-a1fe-fa82750c39bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7c3f54e2c14f789b2efe5b69098b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:37Z,use_quota=True,user_id='931de2e1d5c8400cb59e3116949a3503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a3cb17-d966-40a7-ada1-30b942eaebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a3cb17-d966-40a7-ada1-30b942eaebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c33e99-649a-45ad-be75-ff6987e3bcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c33e99-649a-45ad-be75-ff6987e3bcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9abf1ac8-163e-482a-a1fe-fa82750c39bb', 'volume_name': 'volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:37 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD Sep 11 23:08:37 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d93ee52-d014-48a5-a01b-db4eb6196df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d93ee52-d014-48a5-a01b-db4eb6196df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9878e66-4663-433c-a71b-678f50e7fe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:37 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Volume 9abf1ac8-163e-482a-a1fe-fa82750c39bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb', 'volume_size': 1} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-473426088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abf1ac8-163e-482a-a1fe-fa82750c39bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7c3f54e2c14f789b2efe5b69098b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:37Z,use_quota=True,user_id='931de2e1d5c8400cb59e3116949a3503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Creating volume 9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:37 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:37 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb 1073741824 Sep 11 23:08:37 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:37 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] 1baacf90-ac97-495c-951c-132c1ebb83be was qcow2, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:37 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d Sep 11 23:08:37 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:37 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb 1073741824" returned: 0 in 0.554s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:37 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:08:37 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:38 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.344s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9878e66-4663-433c-a71b-678f50e7fe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70448bce-bd1f-4a8d-939d-334bfe7d6be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:38 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Volume volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb (9abf1ac8-163e-482a-a1fe-fa82750c39bb): created successfully Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70448bce-bd1f-4a8d-939d-334bfe7d6be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Flow 'volume_create_manager' (62ed5dce-c565-4145-9c95-bb44af16e15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a2828543-e1c9-4aa1-8c30-a3e9471dabcd tempest-VolumesActionsTest-1875377461 None] Created volume successfully. Sep 11 23:08:39 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d" returned: 0 in 2.327s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:39 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_t40hiaxvdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:08:39 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Converted 112.00 MB image at 48.11 MB/s Sep 11 23:08:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:39 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d 1G Sep 11 23:08:39 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:40 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d 1G" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Downloaded image 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 4b579755-fb5d-4039-96c9-282f5fa4cb3d successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be for user 3dc138678a4848b18e67bc16b85b655c is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Marking volume 4b579755-fb5d-4039-96c9-282f5fa4cb3d as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Copying metadata from image 1baacf90-ac97-495c-951c-132c1ebb83be to 4b579755-fb5d-4039-96c9-282f5fa4cb3d. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Creating volume glance metadata for volume 4b579755-fb5d-4039-96c9-282f5fa4cb3d backed by image 1baacf90-ac97-495c-951c-132c1ebb83be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f949e090-96f0-44d6-b78f-2bd59db3ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715abb26-9133-401e-8ece-f1e9fb6cb4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:40 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Volume volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d (4b579755-fb5d-4039-96c9-282f5fa4cb3d): created successfully Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715abb26-9133-401e-8ece-f1e9fb6cb4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Flow 'volume_create_manager' (5fb913d2-ccf2-421b-842e-b6e9d1acf52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:40 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-80f92353-7274-44f7-8e97-117301104d44 tempest-TestShelveInstance-2086194318 None] Created volume successfully. Sep 11 23:08:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-286b3c33-ce46-473e-b628-a617f2094cd1 req-8341e804-154f-4d7a-bd8a-33f4ffddf619 tempest-TestShelveInstance-2086194318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-286b3c33-ce46-473e-b628-a617f2094cd1 req-8341e804-154f-4d7a-bd8a-33f4ffddf619 tempest-TestShelveInstance-2086194318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-286b3c33-ce46-473e-b628-a617f2094cd1 req-8341e804-154f-4d7a-bd8a-33f4ffddf619 tempest-TestShelveInstance-2086194318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-286b3c33-ce46-473e-b628-a617f2094cd1 req-8341e804-154f-4d7a-bd8a-33f4ffddf619 tempest-TestShelveInstance-2086194318 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f6169f2-155f-4d45-8385-6df18d1441a3', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:08:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-286b3c33-ce46-473e-b628-a617f2094cd1 req-8341e804-154f-4d7a-bd8a-33f4ffddf619 tempest-TestShelveInstance-2086194318 None] attachment_update completed successfully. Sep 11 23:08:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8565bb40-01e4-4871-ae25-643d1f3f815c tempest-VolumesActionsTest-1875377461 None] Acquiring lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb" by "attach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8565bb40-01e4-4871-ae25-643d1f3f815c tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb" acquired by "attach_volume" :: waited 0.045s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8565bb40-01e4-4871-ae25-643d1f3f815c tempest-VolumesActionsTest-1875377461 None] Attaching volume 9abf1ac8-163e-482a-a1fe-fa82750c39bb to instance 23f71859-b107-4b46-bd4b-9301c410bb63 at mountpoint /dev/vdb on host None. Sep 11 23:08:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8565bb40-01e4-4871-ae25-643d1f3f815c tempest-VolumesActionsTest-1875377461 None] Attach volume completed successfully. Sep 11 23:08:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8565bb40-01e4-4871-ae25-643d1f3f815c tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb" released by "attach_volume" :: held 0.242s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e441a97-dd49-4e8b-b05f-72b3b439d744 tempest-VolumesActionsTest-1875377461 None] Acquiring lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-detach_volume" by "detach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e441a97-dd49-4e8b-b05f-72b3b439d744 tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-detach_volume" acquired by "detach_volume" :: waited 0.121s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1e441a97-dd49-4e8b-b05f-72b3b439d744 tempest-VolumesActionsTest-1875377461 None] Detaching volume 9abf1ac8-163e-482a-a1fe-fa82750c39bb from instance 23f71859-b107-4b46-bd4b-9301c410bb63. Sep 11 23:08:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1e441a97-dd49-4e8b-b05f-72b3b439d744 tempest-VolumesActionsTest-1875377461 None] Detach volume completed successfully. Sep 11 23:08:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e441a97-dd49-4e8b-b05f-72b3b439d744 tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-detach_volume" released by "detach_volume" :: held 0.219s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:59 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:08:59 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:59 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.491s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:08:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Flow 'volume_create_manager' (245d48fc-2776-4053-ba15-c81e303479b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f833b2-c4cc-4149-bb7f-f5f05bafe637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f833b2-c4cc-4149-bb7f-f5f05bafe637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-315826781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba38196-984c-44bc-b033-85bb9aac84b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b935e8e6004afc9f6ee259e8612ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:02Z,use_quota=True,user_id='5b6a498d5fd94e1db00d73fd95479597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f184b26-8890-4057-8898-ed1238bb6bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f184b26-8890-4057-8898-ed1238bb6bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed086fed-586e-49b9-9aeb-d3d22570360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed086fed-586e-49b9-9aeb-d3d22570360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba38196-984c-44bc-b033-85bb9aac84b3', 'volume_name': 'volume-1ba38196-984c-44bc-b033-85bb9aac84b3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4546e-c312-4b7d-9d49-465a89b0f7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4546e-c312-4b7d-9d49-465a89b0f7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44345fcc-bd0a-491a-82b8-1836423017a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Volume 1ba38196-984c-44bc-b033-85bb9aac84b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba38196-984c-44bc-b033-85bb9aac84b3', 'volume_size': 1} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-315826781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba38196-984c-44bc-b033-85bb9aac84b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b935e8e6004afc9f6ee259e8612ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:02Z,use_quota=True,user_id='5b6a498d5fd94e1db00d73fd95479597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Creating volume 1ba38196-984c-44bc-b033-85bb9aac84b3 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:01 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:01 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 1073741824 Sep 11 23:09:01 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 1073741824" returned: 0 in 0.825s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:02 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:02 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 Sep 11 23:09:02 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:03 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3" returned: 0 in 0.401s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44345fcc-bd0a-491a-82b8-1836423017a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba38196-984c-44bc-b033-85bb9aac84b3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f592b0-4038-4074-b74b-32bf893cabee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Volume volume-1ba38196-984c-44bc-b033-85bb9aac84b3 (1ba38196-984c-44bc-b033-85bb9aac84b3): created successfully Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f592b0-4038-4074-b74b-32bf893cabee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Flow 'volume_create_manager' (245d48fc-2776-4053-ba15-c81e303479b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-96c772f7-623f-40ed-86a9-23929289204e tempest-VolumesServicesTestJSON-1579688304 None] Created volume successfully. Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Acquiring lock "cinder-1ba38196-984c-44bc-b033-85bb9aac84b3-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Lock "cinder-1ba38196-984c-44bc-b033-85bb9aac84b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Acquiring lock "cinder-quobyte-1ba38196-984c-44bc-b033-85bb9aac84b3" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Lock "cinder-quobyte-1ba38196-984c-44bc-b033-85bb9aac84b3" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b268a-68e2-4e60-a8cb-b4c4285c5c71]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:04 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 Sep 11 23:09:04 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Flow 'volume_create_manager' (50c2c52f-ae50-4b05-83ba-ea49eb2a4cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138c78dd-c772-4a66-a274-f2337d42eb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138c78dd-c772-4a66-a274-f2337d42eb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1666232949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601bbdde-c62a-4df6-adf2-af498a33d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26ad4f14ee44c33bd807e65ed08a653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:05Z,use_quota=True,user_id='b961866332dc446387ddbd28556beeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a471eb-0bdb-419e-a8e9-9e2bf7f83f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a471eb-0bdb-419e-a8e9-9e2bf7f83f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81214777-be5d-44b8-9eed-319394864bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81214777-be5d-44b8-9eed-319394864bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601bbdde-c62a-4df6-adf2-af498a33d4f0', 'volume_name': 'volume-601bbdde-c62a-4df6-adf2-af498a33d4f0', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1dfe2f-49fa-48c1-9717-94992c651e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1dfe2f-49fa-48c1-9717-94992c651e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76dfe6a-667e-4154-91d8-33d6f98b9b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:04 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Volume 601bbdde-c62a-4df6-adf2-af498a33d4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601bbdde-c62a-4df6-adf2-af498a33d4f0', 'volume_size': 1} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1666232949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601bbdde-c62a-4df6-adf2-af498a33d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26ad4f14ee44c33bd807e65ed08a653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:05Z,use_quota=True,user_id='b961866332dc446387ddbd28556beeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Creating volume 601bbdde-c62a-4df6-adf2-af498a33d4f0 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:04 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:04 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3" returned: 0 in 0.530s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:04 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 1073741824 Sep 11 23:09:04 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:04 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3 Sep 11 23:09:04 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:05 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1ba38196-984c-44bc-b033-85bb9aac84b3" returned: 0 in 0.432s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Lock "cinder-quobyte-1ba38196-984c-44bc-b033-85bb9aac84b3" released by "delete_volume" :: held 1.050s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Created reservations ['18e015d0-005b-4d5f-8f5d-08d3cd4f33a9', '9acb1ccc-4936-41bf-9b14-3d45a07f0906', 'c6372609-1852-4a13-99ae-8331c0bc164a', 'ea8d9085-cf94-4a92-963f-67e4019507fa'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:05 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:05 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:05 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 1073741824" returned: 0 in 0.797s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:05 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 Sep 11 23:09:05 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:05 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.338s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Deleted volume successfully. Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7cf3fd79-acb8-47d7-8af1-65c14932a263 tempest-VolumesServicesTestJSON-1579688304 None] Lock "cinder-1ba38196-984c-44bc-b033-85bb9aac84b3-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:05 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0" returned: 0 in 0.376s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76dfe6a-667e-4154-91d8-33d6f98b9b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601bbdde-c62a-4df6-adf2-af498a33d4f0', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a456f6e8-a7e7-4782-9dc7-1344a37e7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Volume volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 (601bbdde-c62a-4df6-adf2-af498a33d4f0): created successfully Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a456f6e8-a7e7-4782-9dc7-1344a37e7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Flow 'volume_create_manager' (50c2c52f-ae50-4b05-83ba-ea49eb2a4cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-18174f10-ee1d-4291-8480-5a7c9c28104d tempest-VolumesListAdminTestJSON-2022398259 None] Created volume successfully. Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Flow 'volume_create_manager' (907a57ca-4708-423c-ae6d-9bfd84c1fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a540514b-e40d-445d-b1cd-c16a3425c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a540514b-e40d-445d-b1cd-c16a3425c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-194013237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c01a55-195e-43a9-8945-029b284497b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26ad4f14ee44c33bd807e65ed08a653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:08Z,use_quota=True,user_id='b961866332dc446387ddbd28556beeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c6b776-c8fc-4ffa-9c90-402f8eb82a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c6b776-c8fc-4ffa-9c90-402f8eb82a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8208ee-b3a7-472b-985a-5ce4d82c3c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8208ee-b3a7-472b-985a-5ce4d82c3c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c01a55-195e-43a9-8945-029b284497b0', 'volume_name': 'volume-c7c01a55-195e-43a9-8945-029b284497b0', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b5be3b-ecbf-40cb-a7b7-fc582d542474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b5be3b-ecbf-40cb-a7b7-fc582d542474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61ce4bd-2aed-45e5-b156-6a0bcfdfac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Volume c7c01a55-195e-43a9-8945-029b284497b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c01a55-195e-43a9-8945-029b284497b0', 'volume_size': 1} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-194013237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c01a55-195e-43a9-8945-029b284497b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26ad4f14ee44c33bd807e65ed08a653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:08Z,use_quota=True,user_id='b961866332dc446387ddbd28556beeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Creating volume c7c01a55-195e-43a9-8945-029b284497b0 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:08 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:08 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 1073741824 Sep 11 23:09:08 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:09 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 1073741824" returned: 0 in 0.767s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:09 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 Sep 11 23:09:09 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:09 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0" returned: 0 in 0.406s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61ce4bd-2aed-45e5-b156-6a0bcfdfac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c01a55-195e-43a9-8945-029b284497b0', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a9e5ef-266c-4d64-bf3e-e36a8307620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:09 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Volume volume-c7c01a55-195e-43a9-8945-029b284497b0 (c7c01a55-195e-43a9-8945-029b284497b0): created successfully Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a9e5ef-266c-4d64-bf3e-e36a8307620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Flow 'volume_create_manager' (907a57ca-4708-423c-ae6d-9bfd84c1fec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7ca2b2ed-d24f-4e5a-9e55-4a865c4d87d5 tempest-VolumesListAdminTestJSON-2022398259 None] Created volume successfully. Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5315871d-7d50-4119-a0e8-534be27156de tempest-VolumesActionsTest-1875377461 None] Acquiring lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb" by "attach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5315871d-7d50-4119-a0e8-534be27156de tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb" acquired by "attach_volume" :: waited 0.037s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5315871d-7d50-4119-a0e8-534be27156de tempest-VolumesActionsTest-1875377461 None] Attaching volume 9abf1ac8-163e-482a-a1fe-fa82750c39bb to instance 65d1afdf-a55d-49a4-92cd-b804a0546db2 at mountpoint /dev/vdb on host None. Sep 11 23:09:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5315871d-7d50-4119-a0e8-534be27156de tempest-VolumesActionsTest-1875377461 None] Attach volume completed successfully. Sep 11 23:09:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5315871d-7d50-4119-a0e8-534be27156de tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb" released by "attach_volume" :: held 0.154s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-449413ae-fb1f-4eee-9153-6064dacbe444 tempest-VolumesActionsTest-1875377461 None] Acquiring lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-detach_volume" by "detach_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-449413ae-fb1f-4eee-9153-6064dacbe444 tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-449413ae-fb1f-4eee-9153-6064dacbe444 tempest-VolumesActionsTest-1875377461 None] Detaching volume 9abf1ac8-163e-482a-a1fe-fa82750c39bb from instance 65d1afdf-a55d-49a4-92cd-b804a0546db2. Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Flow 'volume_create_manager' (47130d21-be43-4463-b1ab-bf78e3d52c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56252b60-5536-4b35-8d80-645f20cbafe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-449413ae-fb1f-4eee-9153-6064dacbe444 tempest-VolumesActionsTest-1875377461 None] Detach volume completed successfully. Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56252b60-5536-4b35-8d80-645f20cbafe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1754325388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61bf15a-3571-4032-b20a-80771fc79ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26ad4f14ee44c33bd807e65ed08a653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:11Z,use_quota=True,user_id='b961866332dc446387ddbd28556beeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ab68b7-7d99-48c0-93f2-977fa9a8deaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ab68b7-7d99-48c0-93f2-977fa9a8deaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a03d14e-9a33-429d-8e0c-620f2590eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a03d14e-9a33-429d-8e0c-620f2590eb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61bf15a-3571-4032-b20a-80771fc79ae9', 'volume_name': 'volume-c61bf15a-3571-4032-b20a-80771fc79ae9', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d640f6f-3ec6-4494-89d8-812fa788b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d640f6f-3ec6-4494-89d8-812fa788b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbfcfe4-7023-4e90-90ed-8724bd2c1ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Volume c61bf15a-3571-4032-b20a-80771fc79ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61bf15a-3571-4032-b20a-80771fc79ae9', 'volume_size': 1} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1754325388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61bf15a-3571-4032-b20a-80771fc79ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26ad4f14ee44c33bd807e65ed08a653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:11Z,use_quota=True,user_id='b961866332dc446387ddbd28556beeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Creating volume c61bf15a-3571-4032-b20a-80771fc79ae9 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:11 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-449413ae-fb1f-4eee-9153-6064dacbe444 tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-detach_volume" released by "detach_volume" :: held 0.270s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:11 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 1073741824 Sep 11 23:09:11 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:12 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 1073741824" returned: 0 in 0.816s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:12 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 Sep 11 23:09:12 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:12 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9" returned: 0 in 0.433s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbfcfe4-7023-4e90-90ed-8724bd2c1ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61bf15a-3571-4032-b20a-80771fc79ae9', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a176a5-3d18-4920-ba55-4ef7de5598f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Volume volume-c61bf15a-3571-4032-b20a-80771fc79ae9 (c61bf15a-3571-4032-b20a-80771fc79ae9): created successfully Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a176a5-3d18-4920-ba55-4ef7de5598f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Flow 'volume_create_manager' (47130d21-be43-4463-b1ab-bf78e3d52c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-583eea7f-efe6-4b52-b0c9-d2ffff6b6af6 tempest-VolumesListAdminTestJSON-2022398259 None] Created volume successfully. Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Flow 'volume_create_manager' (84cb8f3a-f2a3-4e2b-aec0-cbcf6e248a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c92e06-0975-44b2-9ad6-87fe4ad9a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c92e06-0975-44b2-9ad6-87fe4ad9a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcaa793-b72f-46d6-b21b-c40fe04d5cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf079c6b8e3c4163a96bb88384a74167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:14Z,use_quota=True,user_id='570232b0077c4f7d9913c07c858d1f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36748345-fbcd-4b0b-8cda-086085179086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36748345-fbcd-4b0b-8cda-086085179086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6873d220-d258-40c2-b263-9f4f9c3a34d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6873d220-d258-40c2-b263-9f4f9c3a34d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcaa793-b72f-46d6-b21b-c40fe04d5cdd', 'volume_name': 'volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd4b882-f07f-495e-bfa9-15a6c29c719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd4b882-f07f-495e-bfa9-15a6c29c719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718f41a6-34a7-4e2a-bcb5-bab5dc905ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:14 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Volume 6fcaa793-b72f-46d6-b21b-c40fe04d5cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd', 'volume_size': 1} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcaa793-b72f-46d6-b21b-c40fe04d5cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf079c6b8e3c4163a96bb88384a74167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:14Z,use_quota=True,user_id='570232b0077c4f7d9913c07c858d1f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Creating volume 6fcaa793-b72f-46d6-b21b-c40fe04d5cdd {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:14 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:14 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd 1073741824 Sep 11 23:09:14 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:14 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd 1073741824" returned: 0 in 0.491s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:14 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd Sep 11 23:09:14 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:15 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718f41a6-34a7-4e2a-bcb5-bab5dc905ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26237045-671e-440c-a858-40e01bcde7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Volume volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd (6fcaa793-b72f-46d6-b21b-c40fe04d5cdd): created successfully Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26237045-671e-440c-a858-40e01bcde7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Flow 'volume_create_manager' (84cb8f3a-f2a3-4e2b-aec0-cbcf6e248a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-045e68fa-1ad5-4b37-a7d0-9cc17327bbd8 tempest-VolumesListAdminTestJSON-1709184223 None] Created volume successfully. Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc1053-8f8a-4fed-a1ec-939c70565de5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:16 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:09:16 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Flow 'volume_create_manager' (bb94c702-206a-4154-87ec-9e80d88f0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9879277-75be-40e2-b0af-8dc1180ba29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9879277-75be-40e2-b0af-8dc1180ba29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-120800996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b94a29b-0da7-4dca-9770-05648905f213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bf85dec6144f1c8ac893fe3417d8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:16Z,use_quota=True,user_id='ffa503798e6d4de9976e9a59fd4f5f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9c9a95-f480-4fc6-a978-b4e0dfa9de22),volume_type_id=aa9c9a95-f480-4fc6-a978-b4e0dfa9de22)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf677a5-8a98-42ef-a7ea-8208520b4983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf677a5-8a98-42ef-a7ea-8208520b4983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f02e9ee-8e8e-4ea8-a8ff-c5300c7eaf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f02e9ee-8e8e-4ea8-a8ff-c5300c7eaf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b94a29b-0da7-4dca-9770-05648905f213', 'volume_name': 'volume-6b94a29b-0da7-4dca-9770-05648905f213', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573a6773-e6d5-4085-8414-f10756898565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573a6773-e6d5-4085-8414-f10756898565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6a8f35-b839-4c2f-9c8e-40d87b92921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:16 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Volume 6b94a29b-0da7-4dca-9770-05648905f213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b94a29b-0da7-4dca-9770-05648905f213', 'volume_size': 1} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Acquiring lock "cinder-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "cinder-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Acquiring lock "cinder-quobyte-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "cinder-quobyte-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:16 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.420s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d171d01-fe54-4d3c-9af2-190c49f65fa6]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087bcad-9065-422b-9339-9209b65c8e62]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "cinder-c61bf15a-3571-4032-b20a-80771fc79ae9-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-c61bf15a-3571-4032-b20a-80771fc79ae9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "cinder-quobyte-c61bf15a-3571-4032-b20a-80771fc79ae9" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:16 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd Sep 11 23:09:16 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-quobyte-c61bf15a-3571-4032-b20a-80771fc79ae9" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:16 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:09:16 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf2b571-6979-4973-b6bd-d26a078af006]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:16 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 Sep 11 23:09:16 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:16 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd" returned: 0 in 0.387s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:16 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:16 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd Sep 11 23:09:16 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.4fbb0406-52f5-4d65-bb0a-537869cee9e9m5_pfdlw.img {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:16 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.4fbb0406-52f5-4d65-bb0a-537869cee9e9m5_pfdlw.img Sep 11 23:09:16 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:17 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9" returned: 0 in 0.387s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:17 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9 Sep 11 23:09:17 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:17 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "cinder-quobyte-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd" released by "delete_volume" :: held 0.694s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Created reservations ['d9c8f9f1-3197-4d26-bb98-dec497a18553', '80abedd7-2ff6-423f-8055-6640af135c37', 'e23551e3-3ae3-4183-b0a3-f89ba295ddc9', '7b3536f0-0978-4a96-bf08-20141517da6a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:17 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c61bf15a-3571-4032-b20a-80771fc79ae9" returned: 0 in 0.378s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-quobyte-c61bf15a-3571-4032-b20a-80771fc79ae9" released by "delete_volume" :: held 0.876s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:17 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:17 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Created reservations ['618e32f6-b2a3-4251-9e13-78206564e3a0', '6d2fdc1b-75c0-4936-987c-e735db83e48b', 'd239ab11-cd34-4282-b1d2-a38624dc5a0a', 'dc486c68-b4c3-47a2-887c-699836ee361e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:17 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:17 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:18 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.623s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Deleted volume successfully. Sep 11 23:09:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4406c36a-5b26-45b8-982d-c00671ac9019 tempest-VolumesListAdminTestJSON-1709184223 None] Lock "cinder-6fcaa793-b72f-46d6-b21b-c40fe04d5cdd-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:18 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.364s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Deleted volume successfully. Sep 11 23:09:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e0f60bf5-d59d-455e-8bf2-65e6bb1d907c tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-c61bf15a-3571-4032-b20a-80771fc79ae9-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "cinder-c7c01a55-195e-43a9-8945-029b284497b0-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-c7c01a55-195e-43a9-8945-029b284497b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "cinder-quobyte-c7c01a55-195e-43a9-8945-029b284497b0" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-quobyte-c7c01a55-195e-43a9-8945-029b284497b0" acquired by "delete_volume" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70202fd-5a5f-48b8-bf24-590bae0cddee]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:19 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 Sep 11 23:09:19 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:20 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0" returned: 0 in 0.847s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:20 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0 Sep 11 23:09:20 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:20 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c7c01a55-195e-43a9-8945-029b284497b0" returned: 0 in 0.754s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-quobyte-c7c01a55-195e-43a9-8945-029b284497b0" released by "delete_volume" :: held 1.708s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Created reservations ['619d3b36-b578-483f-9478-49868d32db90', '25518ba6-e2ca-42f2-b01d-d7a67f8ec3a8', 'dd71dd24-b170-4e1d-bec1-279aebf7ae7f', '34ff06fa-0362-424a-a76c-ae4cbf595b43'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:21 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:21 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "cinder-601bbdde-c62a-4df6-adf2-af498a33d4f0-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:21 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.4fbb0406-52f5-4d65-bb0a-537869cee9e9m5_pfdlw.img" returned: 0 in 4.895s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd508837-2fc7-4664-b7be-d444c6c4062a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-601bbdde-c62a-4df6-adf2-af498a33d4f0-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:21 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.558s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "cinder-quobyte-601bbdde-c62a-4df6-adf2-af498a33d4f0" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Deleted volume successfully. Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-quobyte-601bbdde-c62a-4df6-adf2-af498a33d4f0" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-05b4219a-e391-4076-89a2-088a865561da tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-c7c01a55-195e-43a9-8945-029b284497b0-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae6ef18-2cac-4226-b908-80c3a1817c54]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:22 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:09:22 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:22 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 Sep 11 23:09:22 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:22 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0" returned: 0 in 0.381s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:22 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0 Sep 11 23:09:22 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:22 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.604s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.4fbb0406-52f5-4d65-bb0a-537869cee9e9m5_pfdlw.img {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:09:22 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Converted 1024.00 MB image at 208.91 MB/s Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] 4fbb0406-52f5-4d65-bb0a-537869cee9e9 was raw, no need to convert to raw {{(pid=88002) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 11 23:09:22 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-601bbdde-c62a-4df6-adf2-af498a33d4f0" returned: 0 in 0.251s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-quobyte-601bbdde-c62a-4df6-adf2-af498a33d4f0" released by "delete_volume" :: held 0.682s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Created reservations ['da9a0c52-a285-4838-8e01-88c8f69cedf8', '3adab35e-3adb-447a-95f3-28bf32e72dd8', '485ee476-4648-4b17-903d-0f97049f5b92', 'eee220c9-85be-4e45-9665-6006f9c631bd'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:22 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:22 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:23 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.302s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:23 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Deleted volume successfully. Sep 11 23:09:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-bd86ff21-d649-46b0-8d8a-9c2a88a52d8a tempest-VolumesListAdminTestJSON-2022398259 None] Lock "cinder-601bbdde-c62a-4df6-adf2-af498a33d4f0-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:26 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-23ce4954-6726-4766-aa35-947cec6699b8 req-ad9dc732-3880-46a3-8bd4-4658b862ed70 tempest-TestShelveInstance-2086194318 None] Terminate volume connection completed successfully. Sep 11 23:09:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-23ce4954-6726-4766-aa35-947cec6699b8 req-ad9dc732-3880-46a3-8bd4-4658b862ed70 tempest-TestShelveInstance-2086194318 None] Deleting attachment 8f6169f2-155f-4d45-8385-6df18d1441a3. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:09:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5aba2664-a1ff-4683-bd64-4c3ce46413a5 req-ae58319c-9d7e-49bc-a7c2-4435f8089c3a tempest-TestShelveInstance-2086194318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=60,cinder:INSERT=30,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=103,cinder:UPDATE=75,cinder:INSERT=22,cinder:DELETE=7 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Flow 'volume_create_manager' (5555fd79-412c-4cb3-85f4-59970e509671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe9b74f-cd34-45fe-97df-bf24421eefd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe9b74f-cd34-45fe-97df-bf24421eefd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-836358162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b72295-2fb6-4639-be2f-ddeff265b0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eca2301b93496393b4de81ef0d8492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:33Z,use_quota=True,user_id='1a9c5b4389bb4b72b990c1825030d4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206be6df-98b1-4670-b3bb-d17c60ec0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206be6df-98b1-4670-b3bb-d17c60ec0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b61548-9262-4f93-97ae-3097d0fbbc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b61548-9262-4f93-97ae-3097d0fbbc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b72295-2fb6-4639-be2f-ddeff265b0a7', 'volume_name': 'volume-51b72295-2fb6-4639-be2f-ddeff265b0a7', 'volume_size': 2}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120c48aa-8360-4bef-872b-eb7ee5b305bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120c48aa-8360-4bef-872b-eb7ee5b305bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2688333b-1b92-417b-ac5f-9d5f40dac8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:33 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Volume 51b72295-2fb6-4639-be2f-ddeff265b0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b72295-2fb6-4639-be2f-ddeff265b0a7', 'volume_size': 2} Sep 11 23:09:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.186s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Uploaded volume to glance image-id: 4fbb0406-52f5-4d65-bb0a-537869cee9e9. {{(pid=88002) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.867s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-120800996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b94a29b-0da7-4dca-9770-05648905f213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bf85dec6144f1c8ac893fe3417d8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:16Z,use_quota=True,user_id='ffa503798e6d4de9976e9a59fd4f5f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9c9a95-f480-4fc6-a978-b4e0dfa9de22),volume_type_id=aa9c9a95-f480-4fc6-a978-b4e0dfa9de22)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Creating volume 6b94a29b-0da7-4dca-9770-05648905f213 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:43 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:43 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 1073741824 Sep 11 23:09:43 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:43 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dcaba63f-d16f-4729-b816-5219da4c753c tempest-VolumesActionsTest-1875377461 None] Copy volume to image completed successfully. Sep 11 23:09:43 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 1073741824" returned: 0 in 0.397s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:43 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 Sep 11 23:09:43 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:43 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213" returned: 0 in 0.239s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5aba2664-a1ff-4683-bd64-4c3ce46413a5 req-ae58319c-9d7e-49bc-a7c2-4435f8089c3a tempest-TestShelveInstance-2086194318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.287s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6a8f35-b839-4c2f-9c8e-40d87b92921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b94a29b-0da7-4dca-9770-05648905f213', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2764c11-2ab2-4be7-927f-0f223df15527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-5aba2664-a1ff-4683-bd64-4c3ce46413a5 req-ae58319c-9d7e-49bc-a7c2-4435f8089c3a tempest-TestShelveInstance-2086194318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.340s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-836358162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b72295-2fb6-4639-be2f-ddeff265b0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eca2301b93496393b4de81ef0d8492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:33Z,use_quota=True,user_id='1a9c5b4389bb4b72b990c1825030d4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Creating volume 51b72295-2fb6-4639-be2f-ddeff265b0a7 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:43 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 2147483648 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:43 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Volume volume-6b94a29b-0da7-4dca-9770-05648905f213 (6b94a29b-0da7-4dca-9770-05648905f213): created successfully Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2764c11-2ab2-4be7-927f-0f223df15527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Flow 'volume_create_manager' (bb94c702-206a-4154-87ec-9e80d88f0776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:43 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 2147483648 Sep 11 23:09:44 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dbcda077-b4f3-4d74-9fbf-a346240574c6 tempest-VolumeTypesAccessTest-212178185 None] Created volume successfully. Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-5aba2664-a1ff-4683-bd64-4c3ce46413a5 req-ae58319c-9d7e-49bc-a7c2-4435f8089c3a tempest-TestShelveInstance-2086194318 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb181446-9d7e-49de-b975-c2b659189a47', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:09:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-5aba2664-a1ff-4683-bd64-4c3ce46413a5 req-ae58319c-9d7e-49bc-a7c2-4435f8089c3a tempest-TestShelveInstance-2086194318 None] attachment_update completed successfully. Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Acquiring lock "cinder-6b94a29b-0da7-4dca-9770-05648905f213-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Lock "cinder-6b94a29b-0da7-4dca-9770-05648905f213-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Acquiring lock "cinder-quobyte-6b94a29b-0da7-4dca-9770-05648905f213" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Lock "cinder-quobyte-6b94a29b-0da7-4dca-9770-05648905f213" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d93a9-b646-4a46-ae82-b717344301a9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:44 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 Sep 11 23:09:44 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:44 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 2147483648" returned: 0 in 0.653s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:44 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 Sep 11 23:09:44 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:44 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:44 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213 Sep 11 23:09:44 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:45 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7" returned: 0 in 0.334s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2688333b-1b92-417b-ac5f-9d5f40dac8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b72295-2fb6-4639-be2f-ddeff265b0a7', 'volume_size': 2}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae80c0b2-71ab-4995-a8d3-156bd2012f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:45 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Volume volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 (51b72295-2fb6-4639-be2f-ddeff265b0a7): created successfully Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae80c0b2-71ab-4995-a8d3-156bd2012f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Flow 'volume_create_manager' (5555fd79-412c-4cb3-85f4-59970e509671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c3a4e43c-778c-49c5-81c2-4d8f50764a9b tempest-VolumesCloneNegativeTest-1501760696 None] Created volume successfully. Sep 11 23:09:45 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6b94a29b-0da7-4dca-9770-05648905f213" returned: 0 in 0.389s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Lock "cinder-quobyte-6b94a29b-0da7-4dca-9770-05648905f213" released by "delete_volume" :: held 0.939s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:45 devstack cinder-volume[88002]: WARNING cinder.quota [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-651973392 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-651973392, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:09:45 devstack cinder-volume[88002]: WARNING cinder.quota [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-651973392 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-651973392, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Created reservations ['94b2497e-bd51-4aa1-b7dd-eb6f94658286', '768bc4e2-bd6d-4408-b24c-db5a6071b937', 'c6ba4e0a-8c8e-404b-8763-f60f9ef38ab0', 'f113f05c-d244-4496-8f0d-89b199142e20'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Acquiring lock "cinder-51b72295-2fb6-4639-be2f-ddeff265b0a7-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Lock "cinder-51b72295-2fb6-4639-be2f-ddeff265b0a7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad126179-2f6a-4cad-977a-4ca8e3b9b523]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:45 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:45 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Acquiring lock "cinder-quobyte-51b72295-2fb6-4639-be2f-ddeff265b0a7" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Lock "cinder-quobyte-51b72295-2fb6-4639-be2f-ddeff265b0a7" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f67bc5-45f2-4905-8eb2-8b7472121c79]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:45 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:09:45 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:45 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 Sep 11 23:09:45 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:45 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.340s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Deleted volume successfully. Sep 11 23:09:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b15a99b5-2c99-4f4e-87ab-724eb1228a55 tempest-VolumeTypesAccessTest-212178185 None] Lock "cinder-6b94a29b-0da7-4dca-9770-05648905f213-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:46 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.601s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e823bdb-8c6c-41fb-bd83-a6bca2cac8a8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:46 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7" returned: 0 in 0.571s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:46 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7 Sep 11 23:09:46 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:46 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:09:46 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:46 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-51b72295-2fb6-4639-be2f-ddeff265b0a7" returned: 0 in 0.458s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Lock "cinder-quobyte-51b72295-2fb6-4639-be2f-ddeff265b0a7" released by "delete_volume" :: held 1.093s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:46 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.633s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Created reservations ['81056a08-db76-47a4-b0d2-ff11e7229d48', 'b13ef569-3a8c-46da-a8ed-309afdf87529', 'f27135fb-885a-4fe7-bb65-f2db1081a689', '7e55601b-6c7d-45bf-afa3-d3bb4a16a3b3'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:46 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img Sep 11 23:09:46 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:46 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:46 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:47 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.508s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:47 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Deleted volume successfully. Sep 11 23:09:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3b2e6e86-2bd4-4e0b-84fa-25328de1ac43 tempest-VolumesCloneNegativeTest-1501760696 None] Lock "cinder-51b72295-2fb6-4639-be2f-ddeff265b0a7-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:53 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img" returned: 0 in 6.716s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da1857-c887-4f56-a17a-bb1b54aaa82e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:53 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:09:53 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:54 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 1.052s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:54 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:09:54 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Converted 1024.00 MB image at 152.45 MB/s Sep 11 23:09:54 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] 61a47db4-cd4c-43ed-a130-ab4269c45b53 was raw, converting to qcow2 {{(pid=88002) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 11 23:09:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3122f318-9055-477a-9303-034e32c0b517]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:54 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img Sep 11 23:09:54 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:55 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img" returned: 0 in 0.488s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:55 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img Sep 11 23:09:55 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:55 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img" returned: 1 in 0.616s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:09:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:55 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5 Sep 11 23:09:55 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:56 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5" returned: 0 in 0.329s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:56 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Image conversion details: src /opt/stack/data/cinder/conversion/9abf1ac8-163e-482a-a1fe-fa82750c39bb.temp_image.61a47db4-cd4c-43ed-a130-ab4269c45b53n_bxa_r0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:09:56 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 11 23:09:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[256d7cc7-16bf-46ed-a207-52a30c338d00]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:56 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5 Sep 11 23:09:56 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:56 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y6ne36h5" returned: 0 in 0.445s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Flow 'volume_create_manager' (40ab51f6-8584-4625-afc1-659650b83780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac505b1-154b-484b-8822-53ecc7372d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac505b1-154b-484b-8822-53ecc7372d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-362413699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ad175-10a9-4fd7-8be1-868ef76fa116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b342e0f97e364693a09ebf04f8d6f1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:58Z,use_quota=True,user_id='356de3601ea6425fa7e996702699ab91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed89956-44f7-43ed-b761-eeb444467d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed89956-44f7-43ed-b761-eeb444467d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c0fd0-ed86-4cc7-aa96-2b3e3e5c090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.370s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Uploaded volume to glance image-id: 61a47db4-cd4c-43ed-a130-ab4269c45b53. {{(pid=88002) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 23:09:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-af7c4636-31db-4872-beb5-d17d31c0c203 tempest-VolumesActionsTest-1875377461 None] Copy volume to image completed successfully. Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c0fd0-ed86-4cc7-aa96-2b3e3e5c090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '271ad175-10a9-4fd7-8be1-868ef76fa116', 'volume_name': 'volume-271ad175-10a9-4fd7-8be1-868ef76fa116', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2188ea-cc2b-4c50-99c6-4938ba1caca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2188ea-cc2b-4c50-99c6-4938ba1caca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb805771-4b5c-484e-a08e-d3f13efc1b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Volume 271ad175-10a9-4fd7-8be1-868ef76fa116: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-271ad175-10a9-4fd7-8be1-868ef76fa116', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:09:58 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Trying to clone 271ad175-10a9-4fd7-8be1-868ef76fa116 from image 1baacf90-ac97-495c-951c-132c1ebb83be at location (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:59 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:09:59 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:09:59 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:09:59 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.366s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e84cf-a890-40c7-8420-9134df9f4b51]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:59 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD Sep 11 23:09:59 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:59 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be is fetched for user 356de3601ea6425fa7e996702699ab91. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c90f0f0-f5c8-4fcc-bf55-f9379338263c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:00 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD Sep 11 23:10:00 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Acquiring lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:00 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-362413699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ad175-10a9-4fd7-8be1-868ef76fa116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b342e0f97e364693a09ebf04f8d6f1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:58Z,use_quota=True,user_id='356de3601ea6425fa7e996702699ab91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Creating volume 271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:00 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Acquiring lock "cinder-quobyte-9abf1ac8-163e-482a-a1fe-fa82750c39bb" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:00 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 1073741824 Sep 11 23:10:00 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Lock "cinder-quobyte-9abf1ac8-163e-482a-a1fe-fa82750c39bb" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a044af-5414-4b33-a9ec-eb7b9462e8be]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:00 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:10:00 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:01 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.531s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 1073741824" returned: 0 in 0.612s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:01 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb Sep 11 23:10:01 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:01 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 Sep 11 23:10:01 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116" returned: 0 in 0.413s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:01 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9abf1ac8-163e-482a-a1fe-fa82750c39bb" returned: 0 in 0.515s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Lock "cinder-quobyte-9abf1ac8-163e-482a-a1fe-fa82750c39bb" released by "delete_volume" :: held 1.094s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Attempting download of 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 271ad175-10a9-4fd7-8be1-868ef76fa116. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Created reservations ['48313c4a-a2c9-40be-83e2-58f297164b82', '72b421a6-0f5e-4df7-8f4c-46356368a8f5', 'fb5412ea-ddcb-4d3e-ad50-e00132f9820f', '8c40b62c-9bca-4dc8-be9e-e2018363ef9a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd75c46-effb-4567-ae4c-6b4615e01d34]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:01 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6 Sep 11 23:10:01 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:01 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:01 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Flow 'volume_create_manager' (f2155fd5-d368-4428-ad1a-90b4bc1626a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a8539c-2f1d-479c-9f97-7cde45108693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a8539c-2f1d-479c-9f97-7cde45108693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1409561998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c29388d-064b-477c-99e3-90d3e29bec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='402115d46b6740b8801be7a83bd3189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:02Z,use_quota=True,user_id='8cbc04da2b2141a9b407c3ba5728472f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9b8faf-e268-4e8f-97f4-5ab246ac00c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9b8faf-e268-4e8f-97f4-5ab246ac00c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016cc1d2-3011-446a-a35c-8145815800b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016cc1d2-3011-446a-a35c-8145815800b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c29388d-064b-477c-99e3-90d3e29bec26', 'volume_name': 'volume-6c29388d-064b-477c-99e3-90d3e29bec26', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d71cb5-025b-41c7-b109-2be221ff81c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d71cb5-025b-41c7-b109-2be221ff81c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8ecda4-be4b-4180-ae07-c2615d1685ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Volume 6c29388d-064b-477c-99e3-90d3e29bec26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c29388d-064b-477c-99e3-90d3e29bec26', 'volume_size': 1} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1409561998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c29388d-064b-477c-99e3-90d3e29bec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='402115d46b6740b8801be7a83bd3189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:02Z,use_quota=True,user_id='8cbc04da2b2141a9b407c3ba5728472f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Creating volume 6c29388d-064b-477c-99e3-90d3e29bec26 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:02 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 1073741824 Sep 11 23:10:02 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6" returned: 0 in 0.456s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.361s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Deleted volume successfully. Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c483252-66d1-4fc7-8a0f-f837c5f3f73c tempest-VolumesActionsTest-1875377461 None] Lock "cinder-9abf1ac8-163e-482a-a1fe-fa82750c39bb-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:02 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6 Sep 11 23:10:02 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6" returned: 1 in 0.403s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_wbatb8_6' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad7b21-9143-4d4a-9d8b-9839d29b3703]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 1073741824" returned: 0 in 0.558s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 Sep 11 23:10:02 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD Sep 11 23:10:02 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] 1baacf90-ac97-495c-951c-132c1ebb83be was qcow2, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 Sep 11 23:10:02 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26" returned: 0 in 0.361s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8ecda4-be4b-4180-ae07-c2615d1685ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c29388d-064b-477c-99e3-90d3e29bec26', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdd36d-c48c-41e9-9ed9-144db0473cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Volume volume-6c29388d-064b-477c-99e3-90d3e29bec26 (6c29388d-064b-477c-99e3-90d3e29bec26): created successfully Sep 11 23:10:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdd36d-c48c-41e9-9ed9-144db0473cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Flow 'volume_create_manager' (f2155fd5-d368-4428-ad1a-90b4bc1626a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-29e6e0e0-ca8b-4aaf-bb33-3128182b6d56 tempest-VolumesTransfersV357Test-1397776689 None] Created volume successfully. Sep 11 23:10:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-60564f2e-042a-45b0-9f34-f10722b61f51 tempest-VolumesTransfersV357Test-1019305795 None] Transfer volume completed successfully. Sep 11 23:10:05 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116" returned: 0 in 2.143s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_btfa01e8devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:10:05 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Converted 112.00 MB image at 52.20 MB/s Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:05 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 1G Sep 11 23:10:05 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:05 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 1G" returned: 0 in 0.481s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Downloaded image 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume 271ad175-10a9-4fd7-8be1-868ef76fa116 successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be for user 356de3601ea6425fa7e996702699ab91 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Marking volume 271ad175-10a9-4fd7-8be1-868ef76fa116 as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Copying metadata from image 1baacf90-ac97-495c-951c-132c1ebb83be to 271ad175-10a9-4fd7-8be1-868ef76fa116. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Creating volume glance metadata for volume 271ad175-10a9-4fd7-8be1-868ef76fa116 backed by image 1baacf90-ac97-495c-951c-132c1ebb83be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Acquiring lock "cinder-6c29388d-064b-477c-99e3-90d3e29bec26-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-6c29388d-064b-477c-99e3-90d3e29bec26-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb805771-4b5c-484e-a08e-d3f13efc1b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271ad175-10a9-4fd7-8be1-868ef76fa116', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8528c795-18c4-42b1-bb0c-a5f95835cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Acquiring lock "cinder-quobyte-6c29388d-064b-477c-99e3-90d3e29bec26" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Volume volume-271ad175-10a9-4fd7-8be1-868ef76fa116 (271ad175-10a9-4fd7-8be1-868ef76fa116): created successfully Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8528c795-18c4-42b1-bb0c-a5f95835cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Flow 'volume_create_manager' (40ab51f6-8584-4625-afc1-659650b83780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0658f854-3574-4846-8bad-757bb3123d2f tempest-VolumesExtendTest-893919685 None] Created volume successfully. Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-quobyte-6c29388d-064b-477c-99e3-90d3e29bec26" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b1399-bd80-49ab-b92e-97edcd8c42bf]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:06 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 Sep 11 23:10:06 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:06 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26" returned: 0 in 0.517s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:06 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26 Sep 11 23:10:06 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:06 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6c29388d-064b-477c-99e3-90d3e29bec26" returned: 0 in 0.262s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-quobyte-6c29388d-064b-477c-99e3-90d3e29bec26" released by "delete_volume" :: held 0.875s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Created reservations ['ac39ca13-0780-45de-b486-3143edfb366b', '1599d782-6bcd-4ab1-b620-98e6fca0f360', '00a6ebdf-d44e-4681-b45c-527bb5628f6f', 'b81ab1b7-616f-4c69-be4b-d4dfd1acc732'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:06 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:06 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a7970-90bb-4153-9637-aca8a3c5b9a9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:07 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 Sep 11 23:10:07 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:07 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.627s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Deleted volume successfully. Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ec48dead-805c-45e3-889c-3773c9300a89 tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-6c29388d-064b-477c-99e3-90d3e29bec26-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Flow 'volume_create_manager' (4844769f-0b62-4478-a651-505002746069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4deb6ad4-7491-4edc-9f92-4c0824f011f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4deb6ad4-7491-4edc-9f92-4c0824f011f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2078236258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='402115d46b6740b8801be7a83bd3189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:08Z,use_quota=True,user_id='8cbc04da2b2141a9b407c3ba5728472f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:07 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522208dd-cb5a-42cf-8935-fcf54bb11295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522208dd-cb5a-42cf-8935-fcf54bb11295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c05a650-a878-4aa6-bf3c-d97db03d1e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c05a650-a878-4aa6-bf3c-d97db03d1e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea', 'volume_name': 'volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032baa5d-78da-4ba2-880f-53e2061a33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032baa5d-78da-4ba2-880f-53e2061a33b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343baaf3-f343-41ec-9c3e-42fbb5f3bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:07 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Volume 50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea', 'volume_size': 1} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116" returned: 0 in 0.739s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 2G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 2G" returned: 0 in 0.126s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.899s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2078236258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='402115d46b6740b8801be7a83bd3189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:08Z,use_quota=True,user_id='8cbc04da2b2141a9b407c3ba5728472f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Creating volume 50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:08 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:08 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea 1073741824 Sep 11 23:10:08 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-51ac29e3-5ed5-4727-89f9-78d8e8d56fc3 tempest-VolumesExtendTest-893919685 None] Extend volume completed successfully. Sep 11 23:10:08 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea 1073741824" returned: 0 in 0.750s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-271ad175-10a9-4fd7-8be1-868ef76fa116-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Lock "cinder-271ad175-10a9-4fd7-8be1-868ef76fa116-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:08 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea Sep 11 23:10:08 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-quobyte-271ad175-10a9-4fd7-8be1-868ef76fa116" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-271ad175-10a9-4fd7-8be1-868ef76fa116" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e34ba-4f6c-4c9c-aef1-b08d8deaef22]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:09 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 Sep 11 23:10:09 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:09 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea" returned: 0 in 0.325s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343baaf3-f343-41ec-9c3e-42fbb5f3bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57bc0ba-da8d-402c-9fb4-b8c2223aacbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:09 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Volume volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea (50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea): created successfully Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57bc0ba-da8d-402c-9fb4-b8c2223aacbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Flow 'volume_create_manager' (4844769f-0b62-4478-a651-505002746069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cb3554ac-f0ab-427d-9140-fdf12da36674 tempest-VolumesTransfersV357Test-1397776689 None] Created volume successfully. Sep 11 23:10:09 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116" returned: 0 in 0.435s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:09 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116 Sep 11 23:10:09 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:09 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-271ad175-10a9-4fd7-8be1-868ef76fa116" returned: 0 in 0.274s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-271ad175-10a9-4fd7-8be1-868ef76fa116" released by "delete_volume" :: held 0.763s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Created reservations ['1b4dde8f-027a-4803-a2d7-04cdbf93ed90', 'f7c56f1b-90df-4ac7-ab50-b82019543aea', '176be843-9b22-4602-aee0-0fb219d7dd6f', '401644c5-1663-48b9-bb58-8c3dfde41ac4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:09 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:09 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Acquiring lock "cinder-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Acquiring lock "cinder-quobyte-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-quobyte-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3192d23-3ddd-4e3d-912f-bff3e7b4ab89]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:10 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.401s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Deleted volume successfully. Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-821d9474-0cbd-4b2d-8057-6ae0d232cf59 tempest-VolumesExtendTest-893919685 None] Lock "cinder-271ad175-10a9-4fd7-8be1-868ef76fa116-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:10 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea Sep 11 23:10:10 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:10 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Flow 'volume_create_manager' (a124b52a-386c-4264-89f6-66cd1681601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f1a2c2-7adf-44c9-945f-ba469f3a0745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea" returned: 0 in 0.448s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:10 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea Sep 11 23:10:10 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f1a2c2-7adf-44c9-945f-ba469f3a0745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1302961100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3925b0d9-ec1b-46a1-9f14-1e5adba3b70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b342e0f97e364693a09ebf04f8d6f1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:11Z,use_quota=True,user_id='356de3601ea6425fa7e996702699ab91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a23eac6-d105-4402-8929-89ab771d9988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a23eac6-d105-4402-8929-89ab771d9988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193bd5c4-78ac-41ef-9f3f-1cf24e029c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193bd5c4-78ac-41ef-9f3f-1cf24e029c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3925b0d9-ec1b-46a1-9f14-1e5adba3b70b', 'volume_name': 'volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfaf7c5-87b4-427e-90da-b9b15e3dc84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfaf7c5-87b4-427e-90da-b9b15e3dc84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f40dfa8-3d34-4622-a4a4-26b9f564cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:10 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Volume 3925b0d9-ec1b-46a1-9f14-1e5adba3b70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b', 'volume_size': 1} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1302961100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3925b0d9-ec1b-46a1-9f14-1e5adba3b70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b342e0f97e364693a09ebf04f8d6f1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:11Z,use_quota=True,user_id='356de3601ea6425fa7e996702699ab91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Creating volume 3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:10 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:10 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b 1073741824 Sep 11 23:10:10 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:10 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea" returned: 0 in 0.259s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-quobyte-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea" released by "delete_volume" :: held 0.764s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Created reservations ['a6f1277f-03d6-4906-b360-d2baf4f3af61', '715de34d-5497-481c-bd38-422a0a9c9311', '001e1d48-f407-42c6-8793-118463bb1235', 'bee6e3fb-02d4-4676-85f8-95447dad794b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:11 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:11 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:11 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b 1073741824" returned: 0 in 0.575s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:11 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b Sep 11 23:10:11 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:11 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.324s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Deleted volume successfully. Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6efb132a-fb06-4062-bffb-37b9a5edc99a tempest-VolumesTransfersV357Test-1547763579 None] Lock "cinder-50c3363c-a39a-40e6-bf3b-ea42dfe5d9ea-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:11 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f40dfa8-3d34-4622-a4a4-26b9f564cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50ac062-9c00-4318-b3ab-0dc70b46c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Volume volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b (3925b0d9-ec1b-46a1-9f14-1e5adba3b70b): created successfully Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50ac062-9c00-4318-b3ab-0dc70b46c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Flow 'volume_create_manager' (a124b52a-386c-4264-89f6-66cd1681601b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-61c0fe50-a363-47c7-a068-1bdea0bc5a9d tempest-VolumesExtendTest-893919685 None] Created volume successfully. Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Flow 'volume_create_manager' (378f2e71-1d52-482d-9bd5-d920024c9c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd3f2c4-56f9-40f5-b7e6-6951ef111622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd3f2c4-56f9-40f5-b7e6-6951ef111622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1238067717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80db2621-9cac-4411-9001-241d2ea00347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0d4276b744ec2b4a2b38df4bf1e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:13Z,use_quota=True,user_id='5291374e81c64d18a6d57068944e3420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d41662-1aea-454b-abe8-30f9258c1d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d41662-1aea-454b-abe8-30f9258c1d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83321e96-a8ab-49ba-882d-06b1dbc68d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83321e96-a8ab-49ba-882d-06b1dbc68d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80db2621-9cac-4411-9001-241d2ea00347', 'volume_name': 'volume-80db2621-9cac-4411-9001-241d2ea00347', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b8e9bc-84ba-44ec-8b14-40efdddd3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b8e9bc-84ba-44ec-8b14-40efdddd3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6bddf9-3c0a-4794-b52d-5011205f6aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Volume 80db2621-9cac-4411-9001-241d2ea00347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80db2621-9cac-4411-9001-241d2ea00347', 'volume_size': 1} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1238067717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80db2621-9cac-4411-9001-241d2ea00347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0d4276b744ec2b4a2b38df4bf1e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:13Z,use_quota=True,user_id='5291374e81c64d18a6d57068944e3420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Creating volume 80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:12 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:12 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 1073741824 Sep 11 23:10:12 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:13 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 1073741824" returned: 0 in 0.452s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:13 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 Sep 11 23:10:13 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:13 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347" returned: 0 in 0.257s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.604s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Creating offline snapshot bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a of volume 3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6bddf9-3c0a-4794-b52d-5011205f6aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80db2621-9cac-4411-9001-241d2ea00347', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01529c4-3dc6-4d12-b392-797699d4976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba2f79-d04e-475b-ae0d-85c2b8401b44]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Volume volume-80db2621-9cac-4411-9001-241d2ea00347 (80db2621-9cac-4411-9001-241d2ea00347): created successfully Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01529c4-3dc6-4d12-b392-797699d4976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Flow 'volume_create_manager' (378f2e71-1d52-482d-9bd5-d920024c9c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0989a887-387c-4dce-8c90-bee06dde57d8 tempest-VolumesCloneTest-1337057355 None] Created volume successfully. Sep 11 23:10:13 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b Sep 11 23:10:13 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:14 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" returned: 0 in 0.385s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:14 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a 1G Sep 11 23:10:14 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:14 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a 1G" returned: 0 in 0.432s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:14 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a Sep 11 23:10:14 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:14 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:14 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a is being set with open permissions: ugo+rw Sep 11 23:10:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:14 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a Sep 11 23:10:14 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:15 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:15 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info Sep 11 23:10:15 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:15 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Flow 'volume_create_manager' (904bf518-44c4-48ef-b4c4-c291b79160ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c80ab65-a624-4231-bfaf-918f4e0cab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:15 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info is being set with open permissions: ugo+rw Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c80ab65-a624-4231-bfaf-918f4e0cab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-721334700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22faa52-67d2-4640-8279-d9000b55c45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0d4276b744ec2b4a2b38df4bf1e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=80db2621-9cac-4411-9001-241d2ea00347,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:15Z,use_quota=True,user_id='5291374e81c64d18a6d57068944e3420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:15 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info Sep 11 23:10:15 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a67baa8-c910-457a-aba5-ca43d402159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a67baa8-c910-457a-aba5-ca43d402159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0fbf02-0875-4e63-906f-d452140c6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0fbf02-0875-4e63-906f-d452140c6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd22faa52-67d2-4640-8279-d9000b55c45d', 'volume_name': 'volume-d22faa52-67d2-4640-8279-d9000b55c45d', 'volume_size': 2, 'source_volid': '80db2621-9cac-4411-9001-241d2ea00347', 'source_volstatus': 'available'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdabd31-c135-4724-9f7d-0bb948cbeb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdabd31-c135-4724-9f7d-0bb948cbeb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ebe822-bb30-41e5-8ad6-cfbcf4e2966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Volume d22faa52-67d2-4640-8279-d9000b55c45d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d22faa52-67d2-4640-8279-d9000b55c45d', 'volume_size': 2, 'source_volid': '80db2621-9cac-4411-9001-241d2ea00347', 'source_volstatus': 'available'} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:15 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.info" returned: 0 in 0.273s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.192s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:15 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Cloning volume 80db2621-9cac-4411-9001-241d2ea00347 to volume d22faa52-67d2-4640-8279-d9000b55c45d Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Creating offline snapshot 84b604ba-484c-4afb-ac41-ebd867a1d177 of volume 80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:10:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8919a1ce-e8f4-45c5-8008-4c09e6ab1e1e tempest-VolumesExtendTest-893919685 None] Create snapshot completed successfully Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[84870f66-5dd7-4fe2-950b-d1254e999572]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:15 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 Sep 11 23:10:15 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:16 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347" returned: 0 in 0.388s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:16 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 1G Sep 11 23:10:16 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:16 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 1G" returned: 0 in 0.422s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80db2621-9cac-4411-9001-241d2ea00347 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:16 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80db2621-9cac-4411-9001-241d2ea00347 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 Sep 11 23:10:16 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:16 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80db2621-9cac-4411-9001-241d2ea00347 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:16 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 is being set with open permissions: ugo+rw Sep 11 23:10:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:16 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 Sep 11 23:10:16 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:17 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:17 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info Sep 11 23:10:17 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:17 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info" returned: 0 in 0.296s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:17 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info is being set with open permissions: ugo+rw Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:17 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info Sep 11 23:10:17 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:17 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.info" returned: 0 in 0.270s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Acquiring lock "cinder-quobyte-d22faa52-67d2-4640-8279-d9000b55c45d" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-d22faa52-67d2-4640-8279-d9000b55c45d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] snapshot: 84b604ba-484c-4afb-ac41-ebd867a1d177, volume: d22faa52-67d2-4640-8279-d9000b55c45d, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[de22a6ec-7c4f-48ee-8d56-9acadb65b6b1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:18 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 Sep 11 23:10:18 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:18 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177" returned: 0 in 0.433s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80db2621-9cac-4411-9001-241d2ea00347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd432653-eeb4-4264-9931-624facef1683]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:18 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 Sep 11 23:10:18 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:18 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347" returned: 0 in 0.432s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:10:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:18 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d Sep 11 23:10:18 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Flow 'volume_create_manager' (bd4b2efe-72d2-47b0-b0cb-bc7ce174c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc120999-e527-4e27-b88d-994a29960fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc120999-e527-4e27-b88d-994a29960fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-697305412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69da1bc-db46-4d5e-907f-196ce4221f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b9caf42c9f475d84493963da3c5486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:22Z,use_quota=True,user_id='83022df534454fa2a18dd7397a08163f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ee8ba-c0c1-499f-b3a2-c9dca086ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ee8ba-c0c1-499f-b3a2-c9dca086ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036eba90-de54-442b-8148-4fa2508177c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036eba90-de54-442b-8148-4fa2508177c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69da1bc-db46-4d5e-907f-196ce4221f75', 'volume_name': 'volume-b69da1bc-db46-4d5e-907f-196ce4221f75', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c48909-3158-40f1-a286-4ba9f49fde87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c48909-3158-40f1-a286-4ba9f49fde87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be92aff-5981-440d-a9b6-ca112a5111b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:22 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Volume b69da1bc-db46-4d5e-907f-196ce4221f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69da1bc-db46-4d5e-907f-196ce4221f75', 'volume_size': 1} Sep 11 23:10:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:23 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d" returned: 0 in 4.642s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:10:23 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Converted 1024.00 MB image at 220.52 MB/s Sep 11 23:10:23 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d is being set with open permissions: ugo+rw Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:23 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d Sep 11 23:10:23 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:23 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-d22faa52-67d2-4640-8279-d9000b55c45d" released by "_copy_volume_from_snapshot" :: held 5.829s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Acquiring lock "cinder-quobyte-84b604ba-484c-4afb-ac41-ebd867a1d177" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-84b604ba-484c-4afb-ac41-ebd867a1d177" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Deleting offline snapshot 84b604ba-484c-4afb-ac41-ebd867a1d177 of volume 80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] snapshot_file for this snap is: volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380654b-37c8-4001-a665-6338661fc0d1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:23 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 Sep 11 23:10:23 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:24 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80db2621-9cac-4411-9001-241d2ea00347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b7d0b4-f425-408e-9e9e-e7cd7d53aa61]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:24 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 Sep 11 23:10:24 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:24 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347" returned: 0 in 0.507s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:24 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 Sep 11 23:10:24 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:24 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177" returned: 0 in 0.317s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:24 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177 Sep 11 23:10:24 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:25 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347.84b604ba-484c-4afb-ac41-ebd867a1d177" returned: 0 in 0.242s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-84b604ba-484c-4afb-ac41-ebd867a1d177" released by "_delete_snapshot" :: held 1.524s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.515s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.021s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ebe822-bb30-41e5-8ad6-cfbcf4e2966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22faa52-67d2-4640-8279-d9000b55c45d', 'volume_size': 2, 'source_volid': '80db2621-9cac-4411-9001-241d2ea00347', 'source_volstatus': 'available'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b15843-ae9c-410a-9996-6f600ef6ac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb8299-3e28-46c5-a277-4c466a70e25a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:25 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Volume volume-d22faa52-67d2-4640-8279-d9000b55c45d (d22faa52-67d2-4640-8279-d9000b55c45d): created successfully Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b15843-ae9c-410a-9996-6f600ef6ac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Flow 'volume_create_manager' (904bf518-44c4-48ef-b4c4-c291b79160ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:25 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e75b9d50-73e3-4eec-b1bb-b4945eab820f tempest-VolumesCloneTest-1337057355 None] Created volume successfully. Sep 11 23:10:25 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b Sep 11 23:10:25 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:25 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" returned: 0 in 0.384s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a 2G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a 2G" returned: 0 in 0.109s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.539s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-697305412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69da1bc-db46-4d5e-907f-196ce4221f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b9caf42c9f475d84493963da3c5486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:22Z,use_quota=True,user_id='83022df534454fa2a18dd7397a08163f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Creating volume b69da1bc-db46-4d5e-907f-196ce4221f75 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:25 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:25 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 1073741824 Sep 11 23:10:25 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:25 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2b3ffc05-f2e7-4aca-88fb-51761f74faae tempest-VolumesExtendTest-893919685 None] Extend volume completed successfully. Sep 11 23:10:26 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 1073741824" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:26 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 Sep 11 23:10:26 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Lock "cinder-bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-quobyte-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-quobyte-bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Deleting offline snapshot bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a of volume 3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:10:26 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] snapshot_file for this snap is: volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75" returned: 0 in 0.292s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3999027-9525-4290-9140-319a1b7bcad7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be92aff-5981-440d-a9b6-ca112a5111b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69da1bc-db46-4d5e-907f-196ce4221f75', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871176ee-dab8-4d8a-8fee-98d935fa52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:26 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Volume volume-b69da1bc-db46-4d5e-907f-196ce4221f75 (b69da1bc-db46-4d5e-907f-196ce4221f75): created successfully Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871176ee-dab8-4d8a-8fee-98d935fa52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Flow 'volume_create_manager' (bd4b2efe-72d2-47b0-b0cb-bc7ce174c581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:26 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-daaf55c0-13bf-4593-a206-e5300d6965b1 tempest-VolumesNegativeTest-1246317560 None] Created volume successfully. Sep 11 23:10:26 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a Sep 11 23:10:26 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "cinder-d22faa52-67d2-4640-8279-d9000b55c45d-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-d22faa52-67d2-4640-8279-d9000b55c45d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "cinder-quobyte-d22faa52-67d2-4640-8279-d9000b55c45d" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-d22faa52-67d2-4640-8279-d9000b55c45d" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8055c93-088e-45d2-9dca-07e4408c2f32]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:26 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" returned: 0 in 0.392s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbacdf-6769-44ce-87d6-e4697b2e35cc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:27 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d Sep 11 23:10:27 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:27 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b Sep 11 23:10:27 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:27 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d" returned: 0 in 0.379s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:27 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d Sep 11 23:10:27 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:27 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" returned: 0 in 0.355s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:27 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a Sep 11 23:10:27 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:27 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d22faa52-67d2-4640-8279-d9000b55c45d" returned: 0 in 0.244s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-d22faa52-67d2-4640-8279-d9000b55c45d" released by "delete_volume" :: held 0.662s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Created reservations ['6783ee5b-80f4-4db2-a28e-00b2fb0a01d1', 'a75d3ed6-21b3-43ca-864e-b73a4700ef45', 'cb20ca20-d655-4347-9012-53fefe764d75', 'c250175f-e66d-46e3-8a9b-315c87fa6caf'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:27 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:27 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:27 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" returned: 0 in 0.402s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:27 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a Sep 11 23:10:27 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:27 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:27 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Deleted volume successfully. Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1518e84e-2b9b-410e-9ccb-61f881726c12 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-d22faa52-67d2-4640-8279-d9000b55c45d-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:28 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b.bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a" released by "_delete_snapshot" :: held 1.567s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "cinder-80db2621-9cac-4411-9001-241d2ea00347-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" released by "delete_snapshot" :: held 1.598s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-80db2621-9cac-4411-9001-241d2ea00347-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "cinder-quobyte-80db2621-9cac-4411-9001-241d2ea00347" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-80db2621-9cac-4411-9001-241d2ea00347" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Created reservations ['d995ef03-9843-489f-a53a-b502828fd994', '4692e003-89d9-498d-9052-ebab3f1a4198', '372fe682-e8d3-4291-9118-2ff984ebea93', '1eb22925-2e83-4efd-ac86-48c8d4bb0d88'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[511b215a-2fee-468e-9db9-c8dd0dcbfb10]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Delete snapshot completed successfully. Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e15460f1-04e8-4d68-ac8e-f68882cc89be tempest-VolumesExtendTest-893919685 None] Lock "cinder-bd8c9f7e-46e1-41d7-a556-d2c6659a7f5a-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:28 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 Sep 11 23:10:28 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:28 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347" returned: 0 in 0.411s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:28 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347 Sep 11 23:10:28 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Lock "cinder-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Acquiring lock "cinder-quobyte-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f0dc1d-d3c5-46be-99e3-ac39995dcc47]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:28 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b Sep 11 23:10:28 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:28 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-80db2621-9cac-4411-9001-241d2ea00347" returned: 0 in 0.285s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-quobyte-80db2621-9cac-4411-9001-241d2ea00347" released by "delete_volume" :: held 0.762s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Created reservations ['cbdb50f5-9b82-443a-809a-2a20a9c51b72', 'aea282fc-e907-4bf2-b33e-d7aae2e7397a', 'ed5af8d4-b445-487e-b734-fa1fdbd54ce9', '65b726d3-6dd0-4094-80a7-3025a5141705'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:29 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:29 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:29 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" returned: 0 in 0.464s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:29 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b Sep 11 23:10:29 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:29 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.337s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Deleted volume successfully. Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c40191c0-502c-4014-b64e-780540cde9e7 tempest-VolumesCloneTest-1337057355 None] Lock "cinder-80db2621-9cac-4411-9001-241d2ea00347-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:29 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" returned: 0 in 0.339s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Lock "cinder-quobyte-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b" released by "delete_volume" :: held 0.876s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Created reservations ['b2a9604d-a58e-4c5c-84e0-407308134809', '4d3fb004-8edd-4a9a-b9a0-04a69dc7a6f9', 'f37d8861-7b29-439f-8ec7-3a00bd43f4ee', 'bb019ad9-8819-4fbc-b1b2-3dd011892e03'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:29 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:29 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:30 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.342s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:30 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Deleted volume successfully. Sep 11 23:10:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-011a33d2-57ec-4546-a865-55213371bd36 tempest-VolumesExtendTest-893919685 None] Lock "cinder-3925b0d9-ec1b-46a1-9f14-1e5adba3b70b-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=92,cinder:INSERT=24,cinder:UPDATE=116,cinder:DELETE=11 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=94,cinder:UPDATE=116,cinder:DELETE=8,cinder:INSERT=41 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (00d59200-ce17-415f-a703-933d7cfa738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73117f8-d538-47e8-971c-cbd79e5b76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73117f8-d538-47e8-971c-cbd79e5b76dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1484565722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cbe97e-62c0-43f2-a845-9009b9cd00ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:37Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738fa84f-efdb-4d8f-a74a-79a59cbbf2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738fa84f-efdb-4d8f-a74a-79a59cbbf2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8abaca-d915-4c19-96bc-337784fba1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8abaca-d915-4c19-96bc-337784fba1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3cbe97e-62c0-43f2-a845-9009b9cd00ce', 'volume_name': 'volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40305c4d-d112-4d2b-a54b-6832fa8eb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40305c4d-d112-4d2b-a54b-6832fa8eb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715e41c7-2585-4c99-867f-20a961b4876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:37 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Volume b3cbe97e-62c0-43f2-a845-9009b9cd00ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce', 'volume_size': 1} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1484565722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cbe97e-62c0-43f2-a845-9009b9cd00ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:37Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Creating volume b3cbe97e-62c0-43f2-a845-9009b9cd00ce {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:37 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:37 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce 1073741824 Sep 11 23:10:37 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-75056cde-3659-4f90-9fed-b632f206113a tempest-TestShelveInstance-2086194318 None] Terminate volume connection completed successfully. Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-75056cde-3659-4f90-9fed-b632f206113a tempest-TestShelveInstance-2086194318 None] Deleting attachment bb181446-9d7e-49de-b975-c2b659189a47. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Acquiring lock "cinder-4b579755-fb5d-4039-96c9-282f5fa4cb3d-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Lock "cinder-4b579755-fb5d-4039-96c9-282f5fa4cb3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Acquiring lock "cinder-quobyte-4b579755-fb5d-4039-96c9-282f5fa4cb3d" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Lock "cinder-quobyte-4b579755-fb5d-4039-96c9-282f5fa4cb3d" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb270e57-e1b2-4b02-bcf5-445f68b6676a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:38 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d Sep 11 23:10:38 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:38 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce 1073741824" returned: 0 in 0.985s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:38 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce Sep 11 23:10:38 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:38 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d" returned: 0 in 0.668s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:38 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d Sep 11 23:10:38 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:39 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce" returned: 0 in 0.519s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715e41c7-2585-4c99-867f-20a961b4876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7afb97-0e32-4afc-8bf2-a4711a6e7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Volume volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce (b3cbe97e-62c0-43f2-a845-9009b9cd00ce): created successfully Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7afb97-0e32-4afc-8bf2-a4711a6e7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (00d59200-ce17-415f-a703-933d7cfa738d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:39 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4b579755-fb5d-4039-96c9-282f5fa4cb3d" returned: 0 in 0.585s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-84a2a11c-481e-4b01-83d3-600f5cd6c08f tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Lock "cinder-quobyte-4b579755-fb5d-4039-96c9-282f5fa4cb3d" released by "delete_volume" :: held 1.337s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.quota [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Created reservations ['e899c021-01bc-42e3-9017-f6cab4e854ef', 'ef9c43da-61b2-45e8-a662-d3f1d7dc5fee', '121a55ce-1d5a-4641-8dcc-aa3ba2bf220e', 'e7dc1c02-b379-4518-96dc-903002a05fe5'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:39 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:39 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:39 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.manager [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Deleted volume successfully. Sep 11 23:10:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [req-c504d249-4d4c-4778-9f74-7f2d5bdfa8ea req-fa1441ee-99a6-41eb-947c-bd860bc1b6f4 tempest-TestShelveInstance-2086194318 None] Lock "cinder-4b579755-fb5d-4039-96c9-282f5fa4cb3d-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (6f7b270b-15dc-4095-8446-dd120d537e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a6f183-ebb1-4868-825c-235c87755d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a6f183-ebb1-4868-825c-235c87755d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-702449750',display_name='tempest-VolumesGetTest-Volume-27116125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babda759-b1c0-48a4-9a1e-08dfa1d34964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:41Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcae9b6-dba6-4688-beda-2260b31ca9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcae9b6-dba6-4688-beda-2260b31ca9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ae963a-4593-4f87-b49b-9a7374030e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ae963a-4593-4f87-b49b-9a7374030e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babda759-b1c0-48a4-9a1e-08dfa1d34964', 'volume_name': 'volume-babda759-b1c0-48a4-9a1e-08dfa1d34964', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23fc8ac-ba47-4e5f-b8a9-abce48f48396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23fc8ac-ba47-4e5f-b8a9-abce48f48396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22c8925-074e-4e62-900e-34c17a65d942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:40 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Volume babda759-b1c0-48a4-9a1e-08dfa1d34964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babda759-b1c0-48a4-9a1e-08dfa1d34964', 'volume_size': 1} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-702449750',display_name='tempest-VolumesGetTest-Volume-27116125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babda759-b1c0-48a4-9a1e-08dfa1d34964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:41Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Creating volume babda759-b1c0-48a4-9a1e-08dfa1d34964 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:40 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:40 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 1073741824 Sep 11 23:10:40 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:41 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 1073741824" returned: 0 in 0.585s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:41 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 Sep 11 23:10:41 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:41 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22c8925-074e-4e62-900e-34c17a65d942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babda759-b1c0-48a4-9a1e-08dfa1d34964', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09604e98-4724-472e-94f2-3ba564e1beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:41 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Volume volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 (babda759-b1c0-48a4-9a1e-08dfa1d34964): created successfully Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09604e98-4724-472e-94f2-3ba564e1beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (6f7b270b-15dc-4095-8446-dd120d537e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6eeaa42e-76d9-4fdc-8645-80658d70cdca tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:10:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-babda759-b1c0-48a4-9a1e-08dfa1d34964-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Lock "cinder-babda759-b1c0-48a4-9a1e-08dfa1d34964-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-babda759-b1c0-48a4-9a1e-08dfa1d34964" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-babda759-b1c0-48a4-9a1e-08dfa1d34964" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd119f0-e72d-4b1e-a0e2-eeeefcd92906]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:43 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 Sep 11 23:10:43 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:43 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964" returned: 0 in 0.492s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:43 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964 Sep 11 23:10:43 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:43 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-babda759-b1c0-48a4-9a1e-08dfa1d34964" returned: 0 in 0.340s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-babda759-b1c0-48a4-9a1e-08dfa1d34964" released by "delete_volume" :: held 0.889s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:43 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Created reservations ['04ab66ea-15f2-4fbc-9854-4ca9e95de0c0', '9c6100d5-34e0-4156-870a-550f36588c61', '2c651193-7273-4504-9106-7787ec96c393', '2dec6367-d77f-456c-b28e-f0ad9a9dc4f8'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:44 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:44 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-b3cbe97e-62c0-43f2-a845-9009b9cd00ce-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Lock "cinder-b3cbe97e-62c0-43f2-a845-9009b9cd00ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-b3cbe97e-62c0-43f2-a845-9009b9cd00ce" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-b3cbe97e-62c0-43f2-a845-9009b9cd00ce" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e3a700-66aa-426b-b866-f7d085037c22]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:44 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.424s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:10:44 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce Sep 11 23:10:44 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8a9266d0-28a2-45eb-9dfb-8efdc8c0b1a7 tempest-VolumesGetTest-393653394 None] Lock "cinder-babda759-b1c0-48a4-9a1e-08dfa1d34964-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:44 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce" returned: 0 in 0.469s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:44 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce Sep 11 23:10:44 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:45 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b3cbe97e-62c0-43f2-a845-9009b9cd00ce" returned: 0 in 0.317s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-b3cbe97e-62c0-43f2-a845-9009b9cd00ce" released by "delete_volume" :: held 0.845s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Created reservations ['97cb2232-3e5b-4c48-85f5-745a52988d1a', 'db627b90-e82d-44ae-b199-2552689c9f0b', 'c8ca669e-4290-4f31-85b4-122894eb483d', '8c56bb6b-091e-4467-9ee2-1f93b846ca45'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:45 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:45 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:45 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.376s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:10:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-49eb7ece-c498-40a5-9ec0-c0f69a474bd6 tempest-VolumesGetTest-393653394 None] Lock "cinder-b3cbe97e-62c0-43f2-a845-9009b9cd00ce-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (a0262a0d-c182-483d-97be-1b119e3f5c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fe11ea-c21f-4975-bed0-e3e6a7cbd744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fe11ea-c21f-4975-bed0-e3e6a7cbd744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1268548305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28393f92-7e80-47b0-883f-2dbd13abf3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:46Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133ba44d-f7bb-440c-b5b7-75792ee98f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133ba44d-f7bb-440c-b5b7-75792ee98f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6009119-ba4f-4986-8dea-82b26bbc39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6009119-ba4f-4986-8dea-82b26bbc39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28393f92-7e80-47b0-883f-2dbd13abf3fa', 'volume_name': 'volume-28393f92-7e80-47b0-883f-2dbd13abf3fa', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80962286-3b5e-4a48-90c0-92e1bd6bb2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80962286-3b5e-4a48-90c0-92e1bd6bb2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea697e45-ff99-4f01-af96-ec2b9efef1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:46 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Volume 28393f92-7e80-47b0-883f-2dbd13abf3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28393f92-7e80-47b0-883f-2dbd13abf3fa', 'volume_size': 1} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1268548305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28393f92-7e80-47b0-883f-2dbd13abf3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:46Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Creating volume 28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:46 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:46 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa 1073741824 Sep 11 23:10:46 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:46 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa 1073741824" returned: 0 in 0.636s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:47 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa Sep 11 23:10:47 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:47 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea697e45-ff99-4f01-af96-ec2b9efef1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28393f92-7e80-47b0-883f-2dbd13abf3fa', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d1094d-4d79-4be4-a329-5e2f25bfaaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Volume volume-28393f92-7e80-47b0-883f-2dbd13abf3fa (28393f92-7e80-47b0-883f-2dbd13abf3fa): created successfully Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d1094d-4d79-4be4-a329-5e2f25bfaaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (a0262a0d-c182-483d-97be-1b119e3f5c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-394337a8-430c-4b78-8ec6-c2db3e729918 tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (8b3068ca-9617-4088-b803-a2f04c1e36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad129b5-6f14-4099-8610-373c20a61bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (0a4962b8-a3f9-4580-8dbe-58a25ecc8951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b82c353-0f6c-43ef-b0de-67cb49804f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b82c353-0f6c-43ef-b0de-67cb49804f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-684354228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e446b4-f6bf-4a19-b397-a17db90a4582,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=28393f92-7e80-47b0-883f-2dbd13abf3fa,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:49Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256a1d49-d5b8-4022-9560-d04a57408299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256a1d49-d5b8-4022-9560-d04a57408299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f58be88-80a0-4866-919d-d0ba0c1622bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad129b5-6f14-4099-8610-373c20a61bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-437815454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c63e4c5-d25c-432c-bde4-248528d0039e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:49Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc5d699-980d-44ac-a46c-98c981d5fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc5d699-980d-44ac-a46c-98c981d5fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44a4969-017e-4463-b325-46fcfe7fb5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44a4969-017e-4463-b325-46fcfe7fb5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c63e4c5-d25c-432c-bde4-248528d0039e', 'volume_name': 'volume-3c63e4c5-d25c-432c-bde4-248528d0039e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04f096d-b528-4dac-b57a-29295ab149e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04f096d-b528-4dac-b57a-29295ab149e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e17290-77a5-4c98-a925-9a743472c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume 3c63e4c5-d25c-432c-bde4-248528d0039e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c63e4c5-d25c-432c-bde4-248528d0039e', 'volume_size': 1} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-437815454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c63e4c5-d25c-432c-bde4-248528d0039e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:49Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating volume 3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:49 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f58be88-80a0-4866-919d-d0ba0c1622bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '79e446b4-f6bf-4a19-b397-a17db90a4582', 'volume_name': 'volume-79e446b4-f6bf-4a19-b397-a17db90a4582', 'volume_size': 1, 'source_volid': '28393f92-7e80-47b0-883f-2dbd13abf3fa', 'source_volstatus': 'available'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03b96e6-e1d7-412d-8929-d8ccfb07a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e 1073741824 Sep 11 23:10:49 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03b96e6-e1d7-412d-8929-d8ccfb07a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b51db8-f799-4ed1-a21e-be5b5238d3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:49 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Volume 79e446b4-f6bf-4a19-b397-a17db90a4582: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-79e446b4-f6bf-4a19-b397-a17db90a4582', 'volume_size': 1, 'source_volid': '28393f92-7e80-47b0-883f-2dbd13abf3fa', 'source_volstatus': 'available'} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:49 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e 1073741824" returned: 0 in 0.631s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:49 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e Sep 11 23:10:49 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:50 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.998s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:50 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Cloning volume 28393f92-7e80-47b0-883f-2dbd13abf3fa to volume 79e446b4-f6bf-4a19-b397-a17db90a4582 Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e17290-77a5-4c98-a925-9a743472c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c63e4c5-d25c-432c-bde4-248528d0039e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d322b0b-5b5c-4aef-be67-9fd1b8889fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:50 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume volume-3c63e4c5-d25c-432c-bde4-248528d0039e (3c63e4c5-d25c-432c-bde4-248528d0039e): created successfully Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d322b0b-5b5c-4aef-be67-9fd1b8889fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (8b3068ca-9617-4088-b803-a2f04c1e36c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Creating offline snapshot 55926642-0316-4130-9511-79d14c194dff of volume 28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:10:50 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5df55dee-f5b7-4ee5-97ce-c32b29437128 tempest-VolumesSnapshotTestJSON-1417139440 None] Created volume successfully. Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6256431-ba1d-4840-b7b6-3e84a4ae6100]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:50 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa Sep 11 23:10:50 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:50 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa" returned: 0 in 0.492s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:50 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff 1G Sep 11 23:10:50 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Acquiring lock "cinder-b69da1bc-db46-4d5e-907f-196ce4221f75-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Lock "cinder-b69da1bc-db46-4d5e-907f-196ce4221f75-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Acquiring lock "cinder-quobyte-b69da1bc-db46-4d5e-907f-196ce4221f75" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Lock "cinder-quobyte-b69da1bc-db46-4d5e-907f-196ce4221f75" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba06860c-b50d-4579-9c04-b4065e10dace]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:51 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff 1G" returned: 0 in 0.622s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28393f92-7e80-47b0-883f-2dbd13abf3fa -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:51 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28393f92-7e80-47b0-883f-2dbd13abf3fa -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff Sep 11 23:10:51 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:51 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 Sep 11 23:10:51 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:51 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28393f92-7e80-47b0-883f-2dbd13abf3fa -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff" returned: 0 in 0.311s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:51 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff is being set with open permissions: ugo+rw Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:51 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff Sep 11 23:10:51 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:51 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:51 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75 Sep 11 23:10:51 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:52 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:52 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b69da1bc-db46-4d5e-907f-196ce4221f75" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Lock "cinder-quobyte-b69da1bc-db46-4d5e-907f-196ce4221f75" released by "delete_volume" :: held 0.677s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:52 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info Sep 11 23:10:52 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Created reservations ['00a5256a-bcf3-46a1-a436-e25d74de4904', '7a74f0e2-2156-42aa-b140-0ef87e67f88c', '22c49ffe-2da8-4440-b1f4-81c5a676506e', '0c3703cd-1e55-4865-a848-ec9a96f990f7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:52 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:52 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:52 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:52 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info is being set with open permissions: ugo+rw Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:52 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info Sep 11 23:10:52 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:52 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.274s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Deleted volume successfully. Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8fc42780-2e9e-4bcb-9488-8900cd627c12 tempest-VolumesNegativeTest-1246317560 None] Lock "cinder-b69da1bc-db46-4d5e-907f-196ce4221f75-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:52 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.info" returned: 0 in 0.282s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-79e446b4-f6bf-4a19-b397-a17db90a4582" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-79e446b4-f6bf-4a19-b397-a17db90a4582" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] snapshot: 55926642-0316-4130-9511-79d14c194dff, volume: 79e446b4-f6bf-4a19-b397-a17db90a4582, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ce6c4-3b80-4cfa-9b1c-51d471950446]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:53 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff Sep 11 23:10:53 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:53 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff" returned: 0 in 0.453s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28393f92-7e80-47b0-883f-2dbd13abf3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1220d48-c8eb-45dd-91b3-b1013df88d81]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:53 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa Sep 11 23:10:53 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:53 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa" returned: 0 in 0.411s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:10:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:53 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 Sep 11 23:10:53 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:58 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582" returned: 0 in 5.204s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:58 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:10:58 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Converted 1024.00 MB image at 196.75 MB/s Sep 11 23:10:58 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 is being set with open permissions: ugo+rw Sep 11 23:10:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:58 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 Sep 11 23:10:58 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Flow 'volume_create_manager' (c9f97b84-6220-4e7a-a920-2f0a0fa425e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b66a8e2-bf54-4b8d-af6c-800890f21929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b66a8e2-bf54-4b8d-af6c-800890f21929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-949835812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5560ce30-4c45-4ae2-8d72-29dcda718f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62504d7a426d49719e1a510767400eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:59Z,use_quota=True,user_id='a8f29eddc603420a9b8339e02d6fcfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c87cfc8-f365-4faf-b270-98a4cc338e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c87cfc8-f365-4faf-b270-98a4cc338e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed0df53-bb1f-43b8-b00e-13750458d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed0df53-bb1f-43b8-b00e-13750458d743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5560ce30-4c45-4ae2-8d72-29dcda718f56', 'volume_name': 'volume-5560ce30-4c45-4ae2-8d72-29dcda718f56', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96921086-4737-4cfc-871c-66d1d4c79804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96921086-4737-4cfc-871c-66d1d4c79804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdfe729-153c-4184-97f7-6dc80ddf20b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Volume 5560ce30-4c45-4ae2-8d72-29dcda718f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5560ce30-4c45-4ae2-8d72-29dcda718f56', 'volume_size': 1} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:59 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:10:59 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:59 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-79e446b4-f6bf-4a19-b397-a17db90a4582" released by "_copy_volume_from_snapshot" :: held 6.423s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-55926642-0316-4130-9511-79d14c194dff" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-55926642-0316-4130-9511-79d14c194dff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Deleting offline snapshot 55926642-0316-4130-9511-79d14c194dff of volume 28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] snapshot_file for this snap is: volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a6c13-1aff-4cae-9048-1ef324bb0138]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:59 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.261s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 28 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:10:59 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff Sep 11 23:10:59 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:59 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28393f92-7e80-47b0-883f-2dbd13abf3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99184b-d9c2-4944-9a8a-afe1c2cd464a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:59 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa Sep 11 23:10:59 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:00 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa" returned: 0 in 0.535s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:00 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff Sep 11 23:11:00 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:00 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:00 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff Sep 11 23:11:00 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:00 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa.55926642-0316-4130-9511-79d14c194dff" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-55926642-0316-4130-9511-79d14c194dff" released by "_delete_snapshot" :: held 1.582s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.583s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.500s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Creating offline snapshot 0637ba5b-7d54-44de-a9ee-bd7727a388c9 of volume 3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b51db8-f799-4ed1-a21e-be5b5238d3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e446b4-f6bf-4a19-b397-a17db90a4582', 'volume_size': 1, 'source_volid': '28393f92-7e80-47b0-883f-2dbd13abf3fa', 'source_volstatus': 'available'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e583d75c-7973-4863-a344-85e1b78d4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d0fc6f-dfcd-47e1-acc7-7b8acd4c6536]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Volume volume-79e446b4-f6bf-4a19-b397-a17db90a4582 (79e446b4-f6bf-4a19-b397-a17db90a4582): created successfully Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e583d75c-7973-4863-a344-85e1b78d4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (0a4962b8-a3f9-4580-8dbe-58a25ecc8951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-957accc1-a501-441d-a55d-50289ec10d54 tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:11:01 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e Sep 11 23:11:01 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:01 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:01 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 1G Sep 11 23:11:01 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:01 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 1G" returned: 0 in 0.418s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c63e4c5-d25c-432c-bde4-248528d0039e -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:01 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c63e4c5-d25c-432c-bde4-248528d0039e -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 Sep 11 23:11:01 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:02 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c63e4c5-d25c-432c-bde4-248528d0039e -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:02 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 is being set with open permissions: ugo+rw Sep 11 23:11:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:02 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 Sep 11 23:11:02 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:02 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9" returned: 0 in 0.314s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:02 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info Sep 11 23:11:02 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:02 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info" returned: 0 in 0.299s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:02 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info is being set with open permissions: ugo+rw Sep 11 23:11:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:02 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info Sep 11 23:11:02 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:03 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (968e4b28-3ec8-4e68-b3c7-20efc868e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4fc20f-6fe6-491b-97c8-936deb8e72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.info" returned: 0 in 0.359s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.998s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-949835812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5560ce30-4c45-4ae2-8d72-29dcda718f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62504d7a426d49719e1a510767400eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:59Z,use_quota=True,user_id='a8f29eddc603420a9b8339e02d6fcfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Creating volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:03 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4fc20f-6fe6-491b-97c8-936deb8e72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-703616454',display_name='tempest-VolumesGetTest-Volume-1753263104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bc6610-320f-4093-9b56-9bae00f3c61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:03Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb37d4e-a91e-4943-8db1-01cf01787ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:03 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 1073741824 Sep 11 23:11:03 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb37d4e-a91e-4943-8db1-01cf01787ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76c5153-9fd9-4886-80d6-66d89fdc79a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76c5153-9fd9-4886-80d6-66d89fdc79a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bc6610-320f-4093-9b56-9bae00f3c61a', 'volume_name': 'volume-f2bc6610-320f-4093-9b56-9bae00f3c61a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff75504-9599-400a-a698-4311264d1f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff75504-9599-400a-a698-4311264d1f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca6a140-b298-4c04-b2ef-d5cf37d4c92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Volume f2bc6610-320f-4093-9b56-9bae00f3c61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bc6610-320f-4093-9b56-9bae00f3c61a', 'volume_size': 1} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-84e2466e-45e5-49ef-b0fa-471a71ad962d tempest-VolumesSnapshotTestJSON-1417139440 None] Create snapshot completed successfully Sep 11 23:11:03 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 1073741824" returned: 0 in 0.490s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:03 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 Sep 11 23:11:03 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:03 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56" returned: 0 in 0.233s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-703616454',display_name='tempest-VolumesGetTest-Volume-1753263104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bc6610-320f-4093-9b56-9bae00f3c61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:03Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Creating volume f2bc6610-320f-4093-9b56-9bae00f3c61a {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:03 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdfe729-153c-4184-97f7-6dc80ddf20b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5560ce30-4c45-4ae2-8d72-29dcda718f56', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:03 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a 1073741824 Sep 11 23:11:03 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b322b8c-d6c7-4f3b-8fa5-5e4d425c8a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Volume volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 (5560ce30-4c45-4ae2-8d72-29dcda718f56): created successfully Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b322b8c-d6c7-4f3b-8fa5-5e4d425c8a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Flow 'volume_create_manager' (c9f97b84-6220-4e7a-a920-2f0a0fa425e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c69b804a-09e5-4f73-b30d-4c119796e4b3 tempest-VolumesSnapshotListTestJSON-278124809 None] Created volume successfully. Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-0637ba5b-7d54-44de-a9ee-bd7727a388c9-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-0637ba5b-7d54-44de-a9ee-bd7727a388c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-3c63e4c5-d25c-432c-bde4-248528d0039e" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-3c63e4c5-d25c-432c-bde4-248528d0039e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-0637ba5b-7d54-44de-a9ee-bd7727a388c9" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-0637ba5b-7d54-44de-a9ee-bd7727a388c9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Deleting offline snapshot 0637ba5b-7d54-44de-a9ee-bd7727a388c9 of volume 3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] snapshot_file for this snap is: volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:04 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a 1073741824" returned: 0 in 0.566s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef9cb8-400f-4bdd-8992-ef8fb6099698]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a Sep 11 23:11:04 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:04 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 Sep 11 23:11:04 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:04 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.183s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca6a140-b298-4c04-b2ef-d5cf37d4c92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bc6610-320f-4093-9b56-9bae00f3c61a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570471db-3bd5-402a-8d9d-dd2b2f47953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Creating offline snapshot 76cffd11-6e91-49ff-8e91-345eb4e3d88f of volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:04 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Volume volume-f2bc6610-320f-4093-9b56-9bae00f3c61a (f2bc6610-320f-4093-9b56-9bae00f3c61a): created successfully Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570471db-3bd5-402a-8d9d-dd2b2f47953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (968e4b28-3ec8-4e68-b3c7-20efc868e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3740e786-3edd-45bb-a2d4-6584278eca90]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3a4e4e12-93c2-48b7-8587-8dd0b522f9d5 tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:11:04 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9" returned: 0 in 0.410s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c63e4c5-d25c-432c-bde4-248528d0039e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb130e-d9c8-44cf-8e22-0022a343ef3b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 Sep 11 23:11:04 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:05 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e Sep 11 23:11:05 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:05 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56" returned: 0 in 0.453s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:05 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f 1G Sep 11 23:11:05 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:05 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e" returned: 0 in 0.459s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:05 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 Sep 11 23:11:05 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-f2bc6610-320f-4093-9b56-9bae00f3c61a-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Lock "cinder-f2bc6610-320f-4093-9b56-9bae00f3c61a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-f2bc6610-320f-4093-9b56-9bae00f3c61a" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-f2bc6610-320f-4093-9b56-9bae00f3c61a" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e393d69-a73b-4505-959e-5f06e0f4daf5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:05 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:05 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a Sep 11 23:11:05 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9" returned: 0 in 0.405s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:05 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9 Sep 11 23:11:05 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:05 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f 1G" returned: 0 in 0.539s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:05 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:05 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a" returned: 0 in 0.400s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e.0637ba5b-7d54-44de-a9ee-bd7727a388c9" returned: 0 in 0.269s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:06 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a Sep 11 23:11:06 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-0637ba5b-7d54-44de-a9ee-bd7727a388c9" released by "_delete_snapshot" :: held 1.673s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-3c63e4c5-d25c-432c-bde4-248528d0039e" released by "delete_snapshot" :: held 1.707s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['7d1fd61c-494f-41fa-bc65-251f9b6002fa', '05454a46-09a0-4415-8e16-ebd2f9fc90b2', '9f313c7d-6c2b-45b5-b006-c33e6150be75', '665c6d18-18c6-44b1-926d-ffdce444ed8a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:06 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.369s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f is being set with open permissions: ugo+rw Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:06 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:06 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Delete snapshot completed successfully. Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-a660b159-7b0f-4a75-a552-5cdf68d52888 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-0637ba5b-7d54-44de-a9ee-bd7727a388c9-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:06 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f2bc6610-320f-4093-9b56-9bae00f3c61a" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-f2bc6610-320f-4093-9b56-9bae00f3c61a" released by "delete_volume" :: held 0.721s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Created reservations ['138085bd-5b2c-4f77-a974-ac0d1043ca01', 'eaf6e42e-6b00-4963-9cd6-a92151c59480', '5fc39e75-fe7a-4cf2-8faa-7226cca16bd9', 'c586b398-0a23-4528-9321-3950d5d417fc'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:06 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:06 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.459s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:06 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info Sep 11 23:11:06 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-79e446b4-f6bf-4a19-b397-a17db90a4582-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Lock "cinder-79e446b4-f6bf-4a19-b397-a17db90a4582-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-79e446b4-f6bf-4a19-b397-a17db90a4582" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:07 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.464s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-79e446b4-f6bf-4a19-b397-a17db90a4582" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:07 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info" returned: 0 in 0.391s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:07 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info is being set with open permissions: ugo+rw Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[62816dea-4895-4778-ae13-9686d144044f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-299b24e1-fc4e-4787-8d96-8abe9443f7b3 tempest-VolumesGetTest-393653394 None] Lock "cinder-f2bc6610-320f-4093-9b56-9bae00f3c61a-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:07 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info Sep 11 23:11:07 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:07 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 Sep 11 23:11:07 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:07 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.info" returned: 0 in 0.384s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-675f3a93-c411-4ef5-8e46-b8e9989cce89 tempest-VolumesSnapshotListTestJSON-278124809 None] Create snapshot completed successfully Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:07 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (f85c3981-7c40-47e5-9b72-2f60572c953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a54640-6e99-417b-84b1-919375b5fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582" returned: 0 in 0.772s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:07 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582 Sep 11 23:11:07 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a54640-6e99-417b-84b1-919375b5fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1818230627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2041ee9e-1a93-4b7d-b238-c7c4c5349443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:08Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827789a6-88c9-4818-a177-ab7afd2371cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827789a6-88c9-4818-a177-ab7afd2371cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf890862-7a13-4587-86e2-87c22be402d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf890862-7a13-4587-86e2-87c22be402d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2041ee9e-1a93-4b7d-b238-c7c4c5349443', 'volume_name': 'volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930379c3-bdd6-4cfb-9d33-1c31c80874cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930379c3-bdd6-4cfb-9d33-1c31c80874cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecec0435-42db-4839-89d0-c304b9637c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume 2041ee9e-1a93-4b7d-b238-c7c4c5349443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443', 'volume_size': 1} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1818230627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2041ee9e-1a93-4b7d-b238-c7c4c5349443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:08Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating volume 2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:08 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:08 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 1073741824 Sep 11 23:11:08 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:08 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-79e446b4-f6bf-4a19-b397-a17db90a4582" returned: 0 in 0.372s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-79e446b4-f6bf-4a19-b397-a17db90a4582" released by "delete_volume" :: held 1.222s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Created reservations ['98698f3e-9cc3-4c95-b574-278160380e1a', '0433fb9b-875a-4802-99ff-1cb9dea719c4', '95338a0b-4979-427b-a797-7ff996197bf6', '77d26017-ea49-4d90-ac9e-ed56ac8efa17'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:08 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:08 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:08 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 1073741824" returned: 0 in 0.697s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:08 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 Sep 11 23:11:08 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:08 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.390s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:11:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-99b94694-8c3c-4952-a3e7-4bd0126d5801 tempest-VolumesGetTest-393653394 None] Lock "cinder-79e446b4-f6bf-4a19-b397-a17db90a4582-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:09 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443" returned: 0 in 0.328s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.997s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecec0435-42db-4839-89d0-c304b9637c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa53b304-e12a-47cf-ba16-1a3f90eec96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Creating offline snapshot 4f98b69f-47b3-4264-927a-87e1ade074f4 of volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:09 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 (2041ee9e-1a93-4b7d-b238-c7c4c5349443): created successfully Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa53b304-e12a-47cf-ba16-1a3f90eec96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (f85c3981-7c40-47e5-9b72-2f60572c953c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[708c5bae-7034-4cd8-841d-9f90bc489be5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7eb5cdf2-5679-41ce-9ba4-2229c1cf72b9 tempest-VolumesSnapshotTestJSON-1417139440 None] Created volume successfully. Sep 11 23:11:09 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:09 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-28393f92-7e80-47b0-883f-2dbd13abf3fa-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Lock "cinder-28393f92-7e80-47b0-883f-2dbd13abf3fa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-28393f92-7e80-47b0-883f-2dbd13abf3fa" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-28393f92-7e80-47b0-883f-2dbd13abf3fa" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd69611-55d1-4795-ad36-516bcf3d97ed]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:09 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.570s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:09 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa Sep 11 23:11:09 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:09 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 1G Sep 11 23:11:09 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:10 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa" returned: 0 in 0.572s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:10 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa Sep 11 23:11:10 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 1G" returned: 0 in 0.665s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:10 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:10 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-28393f92-7e80-47b0-883f-2dbd13abf3fa" returned: 0 in 0.341s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-28393f92-7e80-47b0-883f-2dbd13abf3fa" released by "delete_volume" :: held 0.999s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Created reservations ['9d39f5b5-cba3-4655-9a81-df4b8129d6a5', '278feafb-58e8-491b-ba6e-891b5d2b8717', '5d10abed-5297-4341-9fc8-b81b392f3e99', '0101d93d-e8eb-4c71-addc-8aab5cca5224'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:10 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:10 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.421s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 is being set with open permissions: ugo+rw Sep 11 23:11:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:11 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:11 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:11 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c113a48-38d0-402a-af9a-4ab56e224653 tempest-VolumesGetTest-393653394 None] Lock "cinder-28393f92-7e80-47b0-883f-2dbd13abf3fa-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:11 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.381s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.236s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Creating offline snapshot a8b838cd-82cc-4a00-979a-6926d93592ab of volume 2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2a7c91cf-6ea4-46eb-bd74-95937f627c3b tempest-VolumesSnapshotListTestJSON-278124809 None] Create snapshot completed successfully Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d79891-b8e8-4fd6-bf18-a3404544e9f9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:11 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 Sep 11 23:11:11 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:11 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443" returned: 0 in 0.418s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:11 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab 1G Sep 11 23:11:11 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:12 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab 1G" returned: 0 in 0.507s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:12 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab Sep 11 23:11:12 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:12 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab" returned: 0 in 0.385s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:12 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab is being set with open permissions: ugo+rw Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:12 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab Sep 11 23:11:12 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (c75bff24-3d51-4f53-8532-7c5f286ecc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a44855f-5b39-4c3a-992c-7001f2c3379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a44855f-5b39-4c3a-992c-7001f2c3379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2036036956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:13Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e306c496-b312-4549-8349-75053cb1f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e306c496-b312-4549-8349-75053cb1f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cebd298-4fde-4466-b862-9ecaa31f9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:11:12 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab" returned: 0 in 0.264s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:13 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info Sep 11 23:11:13 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cebd298-4fde-4466-b862-9ecaa31f9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f', 'volume_name': 'volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277ef06a-1b96-4da0-a444-a23f17b88909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277ef06a-1b96-4da0-a444-a23f17b88909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a75d54-babc-4019-905c-6cf6bafad008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Volume e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Trying to clone e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f from image 1baacf90-ac97-495c-951c-132c1ebb83be at location (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:11:13 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info" returned: 0 in 0.311s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:13 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info is being set with open permissions: ugo+rw Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:13 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info Sep 11 23:11:13 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:11:13 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:11:13 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.info" returned: 0 in 0.372s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.146s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Creating offline snapshot 3339460d-7324-4da7-b9df-88cbe298aaac of volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958b646-c867-4634-a79a-5ab220e44dd7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff7fa75-cae5-40e2-a597-b23179460c0d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9d0c1336-b471-42eb-8106-2224e91a203f tempest-VolumesSnapshotTestJSON-1417139440 None] Create snapshot completed successfully Sep 11 23:11:13 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD Sep 11 23:11:13 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:13 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:13 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be is fetched for user a0495ab5502f4bffa07d862d369b1e80. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:11:14 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.431s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:14 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac 1G Sep 11 23:11:14 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dfe776-159b-4caa-ad4d-b2288914c61c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:14 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD Sep 11 23:11:14 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:14 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac 1G" returned: 0 in 0.640s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:14 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac Sep 11 23:11:14 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (4f1a766e-cc41-4c10-8149-1e218a23ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d24926-f1e9-487b-9ee6-dd8aa549f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d24926-f1e9-487b-9ee6-dd8aa549f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1683794969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae145dc1-9840-4607-84c3-5f120239fa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a8b838cd-82cc-4a00-979a-6926d93592ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:15Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76ca56d-dd58-4330-9e0e-7118fc713dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76ca56d-dd58-4330-9e0e-7118fc713dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb87a1d-5d84-485c-a47e-504174f91438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb87a1d-5d84-485c-a47e-504174f91438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae145dc1-9840-4607-84c3-5f120239fa2c', 'volume_name': 'volume-ae145dc1-9840-4607-84c3-5f120239fa2c', 'volume_size': 2, 'snapshot_id': 'a8b838cd-82cc-4a00-979a-6926d93592ab'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3c79ba-bd27-4dbc-9229-139ce583c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3c79ba-bd27-4dbc-9229-139ce583c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1caaecb-ad75-4092-850e-d19b4646bfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume ae145dc1-9840-4607-84c3-5f120239fa2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae145dc1-9840-4607-84c3-5f120239fa2c', 'volume_size': 2, 'snapshot_id': 'a8b838cd-82cc-4a00-979a-6926d93592ab'} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:15 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac" returned: 0 in 0.299s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:15 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac is being set with open permissions: ugo+rw Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:15 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac Sep 11 23:11:15 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:15 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.732s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2036036956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:13Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Creating volume e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:15 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:15 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f 1073741824 Sep 11 23:11:15 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-011a6d2f-29ec-40f4-9cae-6fba65fbd691 tempest-VolumesSnapshotListTestJSON-278124809 None] Create snapshot completed successfully Sep 11 23:11:16 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f 1073741824" returned: 0 in 0.518s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:16 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f Sep 11 23:11:16 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:16 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" returned: 0 in 0.304s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.293s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-a8b838cd-82cc-4a00-979a-6926d93592ab-ae145dc1-9840-4607-84c3-5f120239fa2c" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-a8b838cd-82cc-4a00-979a-6926d93592ab-ae145dc1-9840-4607-84c3-5f120239fa2c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating volume ae145dc1-9840-4607-84c3-5f120239fa2c from snapshot a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-ae145dc1-9840-4607-84c3-5f120239fa2c" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Attempting download of 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-ae145dc1-9840-4607-84c3-5f120239fa2c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] snapshot: a8b838cd-82cc-4a00-979a-6926d93592ab, volume: ae145dc1-9840-4607-84c3-5f120239fa2c, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[376ac292-2494-416d-9081-6d0ad1e5c1d4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b984da-4ded-48c0-8181-83de1596cf74]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:16 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab Sep 11 23:11:16 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:16 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb Sep 11 23:11:16 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:16 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab" returned: 0 in 0.483s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6884ec3d-e2e8-40c7-9e44-e80767589bc8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-3339460d-7324-4da7-b9df-88cbe298aaac-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-3339460d-7324-4da7-b9df-88cbe298aaac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-3339460d-7324-4da7-b9df-88cbe298aaac" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-3339460d-7324-4da7-b9df-88cbe298aaac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Deleting offline snapshot 3339460d-7324-4da7-b9df-88cbe298aaac of volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] snapshot_file for this snap is: volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:17 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 Sep 11 23:11:17 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e86cd43-05ac-458f-82fb-dd27bfeff661]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb Sep 11 23:11:17 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac Sep 11 23:11:17 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb" returned: 1 in 0.375s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1baacf90-ac97-495c-951c-132c1ebb83be_tncmqekb' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8fe2b-8631-4c66-bbe4-acb492ce6062]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443" returned: 0 in 0.415s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c Sep 11 23:11:17 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD Sep 11 23:11:17 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac" returned: 0 in 0.402s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[86553c6b-3a39-49d0-b60c-cf561eb68f71]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:17 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] 1baacf90-ac97-495c-951c-132c1ebb83be was qcow2, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:11:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f Sep 11 23:11:17 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:18 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.590s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:18 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac Sep 11 23:11:18 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:19 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac" returned: 0 in 1.181s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:19 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac Sep 11 23:11:19 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:19 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.3339460d-7324-4da7-b9df-88cbe298aaac" returned: 0 in 0.585s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-3339460d-7324-4da7-b9df-88cbe298aaac" released by "_delete_snapshot" :: held 2.897s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" released by "delete_snapshot" :: held 2.932s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Created reservations ['2f4627ce-f830-42ef-aac2-82a47f94e12f', 'd91e39d7-75e7-4f20-a2b8-ee8103ed15d5', 'b5ffa9bf-1c7f-47a6-9496-ad550a513d16', '5ddcfd93-6ae9-4d0f-ae54-1c3924a74847'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:20 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Delete snapshot completed successfully. Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50efc78b-8bf8-40f4-b89c-69d227ef13bf tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-3339460d-7324-4da7-b9df-88cbe298aaac-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-4f98b69f-47b3-4264-927a-87e1ade074f4-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-4f98b69f-47b3-4264-927a-87e1ade074f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-4f98b69f-47b3-4264-927a-87e1ade074f4" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-4f98b69f-47b3-4264-927a-87e1ade074f4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Deleting offline snapshot 4f98b69f-47b3-4264-927a-87e1ade074f4 of volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] snapshot_file for this snap is: volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df369e-716a-4269-b56b-f01db5c55ad3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:21 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:21 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:21 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.894s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[69be5793-182f-4c4e-b60c-10b812b9c536]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:22 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:22 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:22 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" returned: 0 in 4.594s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:22 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1baacf90-ac97-495c-951c-132c1ebb83be_0alwv34zdevstack@QuobyteHD, size 112.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:11:22 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Converted 112.00 MB image at 24.35 MB/s Sep 11 23:11:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:22 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f 1G Sep 11 23:11:22 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:22 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.911s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:22 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:22 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:23 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f 1G" returned: 0 in 0.970s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Downloaded image 1baacf90-ac97-495c-951c-132c1ebb83be ((None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}])) to volume e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Temporary image 1baacf90-ac97-495c-951c-132c1ebb83be for user a0495ab5502f4bffa07d862d369b1e80 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Marking volume e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Copying metadata from image 1baacf90-ac97-495c-951c-132c1ebb83be to e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Creating volume glance metadata for volume e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f backed by image 1baacf90-ac97-495c-951c-132c1ebb83be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:11:23 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.915s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:23 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4 Sep 11 23:11:23 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a75d54-babc-4019-905c-6cf6bafad008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f', 'volume_size': 1, 'image_id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1baacf90-ac97-495c-951c-132c1ebb83be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c42d7c37a8744ff1bb3546e9fd06ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1baacf90-ac97-495c-951c-132c1ebb83be', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1baacf90-ac97-495c-951c-132c1ebb83be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:23 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4b7dc4-b8d6-4f72-b1da-6dfb5f27c749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c" returned: 0 in 6.294s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:11:23 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Converted 1024.00 MB image at 162.66 MB/s Sep 11 23:11:23 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c is being set with open permissions: ugo+rw Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Volume volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f (e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f): created successfully Sep 11 23:11:23 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c Sep 11 23:11:23 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4b7dc4-b8d6-4f72-b1da-6dfb5f27c749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (c75bff24-3d51-4f53-8532-7c5f286ecc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ff1f47b5-e60b-405c-bc45-0630ba7c10bc tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:11:24 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.4f98b69f-47b3-4264-927a-87e1ade074f4" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-4f98b69f-47b3-4264-927a-87e1ade074f4" released by "_delete_snapshot" :: held 3.303s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" released by "delete_snapshot" :: held 3.350s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:24 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-ae145dc1-9840-4607-84c3-5f120239fa2c" released by "_copy_volume_from_snapshot" :: held 7.691s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-a8b838cd-82cc-4a00-979a-6926d93592ab-ae145dc1-9840-4607-84c3-5f120239fa2c" released by "_create_volume_from_snapshot" :: held 7.861s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.895s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Created reservations ['ee70ff51-d3a9-4b34-8b0b-963386e68e9e', '2e129d67-39bc-4668-a277-e009e6347462', '826f424c-853f-46d7-9e82-d598512d6187', '7684b3bc-07cb-42df-be35-7e2fd188222d'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1caaecb-ad75-4092-850e-d19b4646bfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae145dc1-9840-4607-84c3-5f120239fa2c', 'volume_size': 2, 'snapshot_id': 'a8b838cd-82cc-4a00-979a-6926d93592ab'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70216b84-e8c3-4d4c-9537-04e41cad6e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:24 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume volume-ae145dc1-9840-4607-84c3-5f120239fa2c (ae145dc1-9840-4607-84c3-5f120239fa2c): created successfully Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70216b84-e8c3-4d4c-9537-04e41cad6e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (4f1a766e-cc41-4c10-8149-1e218a23ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:24 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0e00bff9-6964-4fc4-a6f4-180c6d9be296 tempest-VolumesSnapshotTestJSON-1417139440 None] Created volume successfully. Sep 11 23:11:24 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Delete snapshot completed successfully. Sep 11 23:11:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-043ccb19-6073-4fd2-94b6-9cd4d83251ed tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-4f98b69f-47b3-4264-927a-87e1ade074f4-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (2c1895d2-206f-4c32-87e4-2bc46e58511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67496c-954a-41b8-a2e7-d571cbd8e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-76cffd11-6e91-49ff-8e91-345eb4e3d88f-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67496c-954a-41b8-a2e7-d571cbd8e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2004051185',display_name='tempest-VolumesGetTest-Volume-1122049509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2949a788-7cc8-451f-a35b-3d4a370b1a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:25Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d4b479-4986-4675-8acd-48a1fe040678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d4b479-4986-4675-8acd-48a1fe040678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82854f60-714d-4476-9fde-bd036c766e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82854f60-714d-4476-9fde-bd036c766e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2949a788-7cc8-451f-a35b-3d4a370b1a26', 'volume_name': 'volume-2949a788-7cc8-451f-a35b-3d4a370b1a26', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24d5f8a-4b60-4a3d-b80d-faf573dcbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24d5f8a-4b60-4a3d-b80d-faf573dcbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f209361-e1dc-4a29-89fd-c41175b85244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:25 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Volume 2949a788-7cc8-451f-a35b-3d4a370b1a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2949a788-7cc8-451f-a35b-3d4a370b1a26', 'volume_size': 1} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2004051185',display_name='tempest-VolumesGetTest-Volume-1122049509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2949a788-7cc8-451f-a35b-3d4a370b1a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9ae53416664482857f0b80a73ec257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:25Z,use_quota=True,user_id='a0495ab5502f4bffa07d862d369b1e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Creating volume 2949a788-7cc8-451f-a35b-3d4a370b1a26 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:25 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-76cffd11-6e91-49ff-8e91-345eb4e3d88f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.118s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 1073741824 Sep 11 23:11:25 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-76cffd11-6e91-49ff-8e91-345eb4e3d88f" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-76cffd11-6e91-49ff-8e91-345eb4e3d88f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Deleting offline snapshot 76cffd11-6e91-49ff-8e91-345eb4e3d88f of volume 5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] snapshot_file for this snap is: volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b07f44-c4b9-413e-9eeb-cd1cf36e93ee]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-ae145dc1-9840-4607-84c3-5f120239fa2c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:25 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-ae145dc1-9840-4607-84c3-5f120239fa2c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-ae145dc1-9840-4607-84c3-5f120239fa2c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-ae145dc1-9840-4607-84c3-5f120239fa2c" acquired by "delete_volume" :: waited 0.029s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9f630c-bf62-425e-b313-8cff79b3b0b2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:26 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c Sep 11 23:11:26 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.676s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5560ce30-4c45-4ae2-8d72-29dcda718f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa3e2f-24bd-48d8-bf6f-79377a23c076]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:26 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 1073741824" returned: 0 in 0.882s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:26 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 Sep 11 23:11:26 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 Sep 11 23:11:26 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26" returned: 0 in 0.323s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f209361-e1dc-4a29-89fd-c41175b85244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2949a788-7cc8-451f-a35b-3d4a370b1a26', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3179e0d-8259-4098-bbf8-6f8d7b84997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:26 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c" returned: 0 in 0.849s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:26 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Volume volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 (2949a788-7cc8-451f-a35b-3d4a370b1a26): created successfully Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3179e0d-8259-4098-bbf8-6f8d7b84997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Flow 'volume_create_manager' (2c1895d2-206f-4c32-87e4-2bc46e58511e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:26 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c Sep 11 23:11:26 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7dc14a55-8cc6-49a1-94d5-506a63e26f00 tempest-VolumesGetTest-393653394 None] Created volume successfully. Sep 11 23:11:26 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56" returned: 0 in 0.597s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:26 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:26 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ae145dc1-9840-4607-84c3-5f120239fa2c" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-ae145dc1-9840-4607-84c3-5f120239fa2c" released by "delete_volume" :: held 1.219s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:26 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['d14d7cca-7758-441a-8a0a-e0da4790546d', '14be346e-45c0-4a09-a7c9-61c65529b10b', 'a1deaa66-7b34-4224-9ecd-8cd9b8cb2224', '57be703d-4d03-4582-ab01-93bbe83f0ead'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:27 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:27 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:27 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.458s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:27 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f Sep 11 23:11:27 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:27 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.322s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Deleted volume successfully. Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-2949a788-7cc8-451f-a35b-3d4a370b1a26-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-41abd46e-9497-4f07-80ad-a7e4813aa452 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-ae145dc1-9840-4607-84c3-5f120239fa2c-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Lock "cinder-2949a788-7cc8-451f-a35b-3d4a370b1a26-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-2949a788-7cc8-451f-a35b-3d4a370b1a26" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-2949a788-7cc8-451f-a35b-3d4a370b1a26" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:27 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56.76cffd11-6e91-49ff-8e91-345eb4e3d88f" returned: 0 in 0.328s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[51004d7e-8bea-4e8e-8f10-40ce99315cab]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-76cffd11-6e91-49ff-8e91-345eb4e3d88f" released by "_delete_snapshot" :: held 2.208s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" released by "delete_snapshot" :: held 2.245s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Created reservations ['ccba0011-1643-4e2f-b7ce-1662f444cc48', '838f1fbb-eeb9-4e7a-8ab0-b47d6ee426d1', 'b3a7de3f-39fc-4437-9ad7-b238f7b04b2c', 'ac530c50-28c9-4e28-90f9-636e397a24fa'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:27 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 Sep 11 23:11:27 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Delete snapshot completed successfully. Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-aef15607-cea7-412a-ac12-9d6da4875152 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-76cffd11-6e91-49ff-8e91-345eb4e3d88f-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-a8b838cd-82cc-4a00-979a-6926d93592ab-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-a8b838cd-82cc-4a00-979a-6926d93592ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-2041ee9e-1a93-4b7d-b238-c7c4c5349443" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26" returned: 0 in 0.420s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-2041ee9e-1a93-4b7d-b238-c7c4c5349443" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-a8b838cd-82cc-4a00-979a-6926d93592ab" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26 Sep 11 23:11:27 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-a8b838cd-82cc-4a00-979a-6926d93592ab" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Deleting offline snapshot a8b838cd-82cc-4a00-979a-6926d93592ab of volume 2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] snapshot_file for this snap is: volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc57858-5c7a-49f3-9519-f69b9dfb0e0a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab Sep 11 23:11:28 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:28 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2949a788-7cc8-451f-a35b-3d4a370b1a26" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-2949a788-7cc8-451f-a35b-3d4a370b1a26" released by "delete_volume" :: held 0.765s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Created reservations ['7dc481da-8496-4da8-bbc3-74419f70310a', 'da685b73-df3f-43b6-9f95-16bc8b0fb3a7', 'e7012611-a5d9-4646-b46b-7710595b11b4', 'b68c1197-5f9a-47ad-974a-2cc094196b58'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:28 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:28 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab" returned: 0 in 0.456s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-5560ce30-4c45-4ae2-8d72-29dcda718f56-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0fd53d-5718-42cf-8c48-9cbab5db0bcd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-5560ce30-4c45-4ae2-8d72-29dcda718f56-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:28 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:28 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ab808-ae20-471e-a805-61dff59f4474]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:28 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d287dbd6-8a26-4500-9695-2a3a52ea9a81 tempest-VolumesGetTest-393653394 None] Lock "cinder-2949a788-7cc8-451f-a35b-3d4a370b1a26-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Lock "cinder-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Acquiring lock "cinder-quobyte-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3b9d3d-408b-417e-8a30-0e8375dcdb9a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 Sep 11 23:11:28 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f Sep 11 23:11:29 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56" returned: 0 in 0.514s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:29 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443" returned: 0 in 0.752s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:29 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56 Sep 11 23:11:29 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab Sep 11 23:11:29 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" returned: 0 in 0.491s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:29 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f Sep 11 23:11:29 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5560ce30-4c45-4ae2-8d72-29dcda718f56" returned: 0 in 0.327s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-quobyte-5560ce30-4c45-4ae2-8d72-29dcda718f56" released by "delete_volume" :: held 0.939s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Created reservations ['69519df6-3e65-4a25-bb15-6c92863efe65', '45897393-6f81-4b7d-ac17-c0f0a4c8fbc5', 'a30a988d-cbb5-4cf0-9bd5-240b33d9341f', '3484adbe-558d-472c-86e3-0c4b375a4a26'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:29 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Lock "cinder-quobyte-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f" released by "delete_volume" :: held 0.824s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:29 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab" returned: 0 in 0.515s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:29 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:29 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Created reservations ['5d58f5c3-991e-404d-9df5-58a17156909f', 'db29006d-5457-4faf-8b70-e565be14355b', '38073c35-0a46-41b9-a862-b0313bea2154', '143e0d3b-197f-4887-b467-ba8b7dfd4554'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:29 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab Sep 11 23:11:29 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:30 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:30 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:30 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443.a8b838cd-82cc-4a00-979a-6926d93592ab" returned: 0 in 0.413s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:30 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:30 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.522s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-a8b838cd-82cc-4a00-979a-6926d93592ab" released by "_delete_snapshot" :: held 2.366s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Deleted volume successfully. Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Flow 'volume_create_manager' (4569d6dd-a28f-475f-9f02-1cdf249fa8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b92908-1c2c-4c5b-9b91-d6c70340e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-2041ee9e-1a93-4b7d-b238-c7c4c5349443" released by "delete_snapshot" :: held 2.436s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1c9c54-f082-470f-8b02-58ceb44be087 tempest-VolumesSnapshotListTestJSON-278124809 None] Lock "cinder-5560ce30-4c45-4ae2-8d72-29dcda718f56-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b92908-1c2c-4c5b-9b91-d6c70340e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1445656794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ca137a-f6d7-4f70-b16b-d60428847685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aea575f263149079804842bf273261c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:30Z,use_quota=True,user_id='35ec9e8ed11540daae4a697b3cb54f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d71a5bc-63f6-429a-82d1-6e9116df4de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d71a5bc-63f6-429a-82d1-6e9116df4de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df2f2ba-9328-4e4a-b09e-52dba7a28abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df2f2ba-9328-4e4a-b09e-52dba7a28abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ca137a-f6d7-4f70-b16b-d60428847685', 'volume_name': 'volume-96ca137a-f6d7-4f70-b16b-d60428847685', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee566b4e-bb0e-4ad8-8173-b96423fd2c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee566b4e-bb0e-4ad8-8173-b96423fd2c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e003f1d-ed28-437d-a1c5-60506f6537e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Volume 96ca137a-f6d7-4f70-b16b-d60428847685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ca137a-f6d7-4f70-b16b-d60428847685', 'volume_size': 1} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1445656794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ca137a-f6d7-4f70-b16b-d60428847685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aea575f263149079804842bf273261c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:30Z,use_quota=True,user_id='35ec9e8ed11540daae4a697b3cb54f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Creating volume 96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:30 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Deleted volume successfully. Sep 11 23:11:30 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 1073741824 Sep 11 23:11:30 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d00e1d00-911e-4541-8528-b2b01f3d76f8 tempest-VolumesGetTest-393653394 None] Lock "cinder-e7fb49be-5cf6-4dfa-8c0c-4421f6f9463f-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['f0db8f22-7f47-4165-99c6-5c4630cfd450', 'c775c41a-41da-4c75-8684-ed72ab1f4612', 'db98834f-59db-4156-8804-b80889fee40e', 'b76c2ecb-a202-4906-bf14-c2d010a33a3f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Delete snapshot completed successfully. Sep 11 23:11:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-696bfe90-bbee-48f4-8e98-456972e9ae44 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-a8b838cd-82cc-4a00-979a-6926d93592ab-delete_snapshot" released by "delete_snapshot" :: held 2.780s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:31 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 1073741824" returned: 0 in 0.591s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:31 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 Sep 11 23:11:31 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-2041ee9e-1a93-4b7d-b238-c7c4c5349443-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-2041ee9e-1a93-4b7d-b238-c7c4c5349443-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-2041ee9e-1a93-4b7d-b238-c7c4c5349443" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-2041ee9e-1a93-4b7d-b238-c7c4c5349443" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:31 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685" returned: 0 in 0.397s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[134005d9-ebaa-40be-9149-eb9b0506ecbc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e003f1d-ed28-437d-a1c5-60506f6537e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ca137a-f6d7-4f70-b16b-d60428847685', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2f437e-5e46-40df-be7b-8af89d207d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Volume volume-96ca137a-f6d7-4f70-b16b-d60428847685 (96ca137a-f6d7-4f70-b16b-d60428847685): created successfully Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2f437e-5e46-40df-be7b-8af89d207d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:31 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 Sep 11 23:11:31 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Flow 'volume_create_manager' (4569d6dd-a28f-475f-9f02-1cdf249fa8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8f7a7a7a-e825-4203-93e1-7ce65ba0c7a7 tempest-TestStampPattern-1193458763 None] Created volume successfully. Sep 11 23:11:32 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443" returned: 0 in 0.516s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:32 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443 Sep 11 23:11:32 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:32 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2041ee9e-1a93-4b7d-b238-c7c4c5349443" returned: 0 in 0.351s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-2041ee9e-1a93-4b7d-b238-c7c4c5349443" released by "delete_volume" :: held 0.985s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['c41efc20-8ae9-43ac-859b-c73c05b42834', '7129b36e-9358-4b91-87b4-9841e7acd21a', 'cc5bd276-6c03-488d-b525-8d03c95c8db1', '85424c4a-4f83-4320-b6ae-b1c32aba8ec0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:32 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:32 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:33 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:33 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Deleted volume successfully. Sep 11 23:11:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-592eb44c-ff31-424b-86f7-5d2e3ed48f66 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-2041ee9e-1a93-4b7d-b238-c7c4c5349443-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (70dd78bd-31f7-4897-aaea-30ebb8654cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea59b13f-e13d-4128-9932-dedca60e9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea59b13f-e13d-4128-9932-dedca60e9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153812486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:34Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a8db7b-a9bd-41b5-aae3-6672ee60fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a8db7b-a9bd-41b5-aae3-6672ee60fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117fba0f-a380-43fd-90ef-7459fd215a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117fba0f-a380-43fd-90ef-7459fd215a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac', 'volume_name': 'volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96c9393-95c3-4053-b9f8-1ed3a4650e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96c9393-95c3-4053-b9f8-1ed3a4650e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b99317-21a2-43fc-9246-820e7f47d1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac', 'volume_size': 1} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153812486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:34Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating volume d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:34 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:34 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac 1073741824 Sep 11 23:11:34 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:35 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac 1073741824" returned: 0 in 0.678s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:35 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac Sep 11 23:11:35 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:35 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b99317-21a2-43fc-9246-820e7f47d1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b2e389-7918-400b-8fc1-63961f72fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac (d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac): created successfully Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b2e389-7918-400b-8fc1-63961f72fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (70dd78bd-31f7-4897-aaea-30ebb8654cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f2c471b4-f9da-4bf1-bec9-33570f62d4d3 tempest-VolumesSnapshotTestJSON-1417139440 None] Created volume successfully. Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (2a936322-e832-41cd-9653-f66c4755cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405fc272-6a79-4d3f-8014-16ad78b77340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405fc272-6a79-4d3f-8014-16ad78b77340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-297426307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf3476b-ed44-451e-a88e-f47b10208680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:36Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3ba09d-7822-494e-be03-e1a5ff69759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3ba09d-7822-494e-be03-e1a5ff69759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f1d2f0-154f-47cb-b89d-d31c166675d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f1d2f0-154f-47cb-b89d-d31c166675d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf3476b-ed44-451e-a88e-f47b10208680', 'volume_name': 'volume-ebf3476b-ed44-451e-a88e-f47b10208680', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ba7cda-e9de-495d-a390-91170fecee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ba7cda-e9de-495d-a390-91170fecee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd9e706-5a00-45c2-969d-3f8a443814e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume ebf3476b-ed44-451e-a88e-f47b10208680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf3476b-ed44-451e-a88e-f47b10208680', 'volume_size': 1} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-297426307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf3476b-ed44-451e-a88e-f47b10208680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:36Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating volume ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:36 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:36 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 1073741824 Sep 11 23:11:36 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Flow 'volume_create_manager' (dcafb225-cfd8-412b-a1e0-07d4b6c2ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00462866-bd76-449a-8d4b-a337c932bf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00462866-bd76-449a-8d4b-a337c932bf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-365837974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f6b241-cae1-478b-ab82-c426ef6c9bd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e00bb102f8dd4b4e94fcf70a8156f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:36Z,use_quota=True,user_id='f2b539a2aa2340a3bd24e1ea8735a03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bbe04a-e7a5-4902-b855-6a53dc01e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bbe04a-e7a5-4902-b855-6a53dc01e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb9446a-1478-43b3-8519-57a59bf73123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb9446a-1478-43b3-8519-57a59bf73123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f6b241-cae1-478b-ab82-c426ef6c9bd4', 'volume_name': 'volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a35b22-65f4-4411-a16b-130b07a89068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a35b22-65f4-4411-a16b-130b07a89068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884fbc25-9a6a-414f-9545-cfc11ae34d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:36 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Volume 61f6b241-cae1-478b-ab82-c426ef6c9bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4', 'volume_size': 1} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:36 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 1073741824" returned: 0 in 0.549s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:36 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 Sep 11 23:11:36 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:37 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680" returned: 0 in 0.318s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-365837974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f6b241-cae1-478b-ab82-c426ef6c9bd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e00bb102f8dd4b4e94fcf70a8156f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:36Z,use_quota=True,user_id='f2b539a2aa2340a3bd24e1ea8735a03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Creating volume 61f6b241-cae1-478b-ab82-c426ef6c9bd4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:37 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd9e706-5a00-45c2-969d-3f8a443814e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf3476b-ed44-451e-a88e-f47b10208680', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88bb6e8-5b12-4086-8be4-e0ac232f6eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:37 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 1073741824 Sep 11 23:11:37 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:37 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume volume-ebf3476b-ed44-451e-a88e-f47b10208680 (ebf3476b-ed44-451e-a88e-f47b10208680): created successfully Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88bb6e8-5b12-4086-8be4-e0ac232f6eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (2a936322-e832-41cd-9653-f66c4755cad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-83d8d4d9-af6f-4653-b0e4-98cc383aa4da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created volume successfully. Sep 11 23:11:37 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 1073741824" returned: 0 in 0.515s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=159,cinder:UPDATE=162,cinder:INSERT=54,cinder:DELETE=21 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=141,cinder:UPDATE=192,cinder:INSERT=46,cinder:DELETE=10 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:11:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:37 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 Sep 11 23:11:37 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:38 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4" returned: 0 in 0.441s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.244s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Creating offline snapshot 36329d39-629a-4ddd-bb23-b5acf27d9775 of volume d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884fbc25-9a6a-414f-9545-cfc11ae34d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202dd96c-0685-4672-8862-bcbc949b27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7916232-a5bc-415e-99a5-72969b630c46]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:38 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Volume volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 (61f6b241-cae1-478b-ab82-c426ef6c9bd4): created successfully Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202dd96c-0685-4672-8862-bcbc949b27d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Flow 'volume_create_manager' (dcafb225-cfd8-412b-a1e0-07d4b6c2ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fb604a11-a8c3-4a96-b907-0be3927a1b55 tempest-VolumesListTestJSON-1370251748 None] Created volume successfully. Sep 11 23:11:38 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac Sep 11 23:11:38 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:39 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" returned: 0 in 0.872s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:39 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 1G Sep 11 23:11:39 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Flow 'volume_create_manager' (0db0bc90-1ef5-4865-95f9-c5b7176d5578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a99772-067a-4e08-abcf-255dca4d55ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a99772-067a-4e08-abcf-255dca4d55ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1803655541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86171970-6cd4-4cbc-8be0-8118d7a17634,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e00bb102f8dd4b4e94fcf70a8156f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:39Z,use_quota=True,user_id='f2b539a2aa2340a3bd24e1ea8735a03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e9a578-66c2-41d8-88ee-9c153f2530b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e9a578-66c2-41d8-88ee-9c153f2530b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e897d269-f9a2-47bb-b2c7-64798ae60013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e897d269-f9a2-47bb-b2c7-64798ae60013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86171970-6cd4-4cbc-8be0-8118d7a17634', 'volume_name': 'volume-86171970-6cd4-4cbc-8be0-8118d7a17634', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfbe525-db14-481f-a3f5-452eadc6b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfbe525-db14-481f-a3f5-452eadc6b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3060d4-99f5-4f5a-a976-e06d30602ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Volume 86171970-6cd4-4cbc-8be0-8118d7a17634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86171970-6cd4-4cbc-8be0-8118d7a17634', 'volume_size': 1} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:39 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 1G" returned: 0 in 0.603s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:39 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 Sep 11 23:11:39 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:40 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775" returned: 0 in 0.323s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:40 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 is being set with open permissions: ugo+rw Sep 11 23:11:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:40 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 Sep 11 23:11:40 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:40 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775" returned: 0 in 0.290s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:40 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info Sep 11 23:11:40 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:40 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info" returned: 0 in 0.297s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:40 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info is being set with open permissions: ugo+rw Sep 11 23:11:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:40 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info Sep 11 23:11:40 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:41 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.info" returned: 0 in 0.274s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.067s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating offline snapshot b833ffb3-25e7-49b8-9c89-4baa53b4b50b of volume ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cef8d26a-8348-4f5e-8fb2-36f4fbf2588a tempest-VolumesSnapshotTestJSON-1417139440 None] Create snapshot completed successfully Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e7ca03-1cff-4df7-962d-e3088076233b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:41 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 Sep 11 23:11:41 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:41 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680" returned: 0 in 0.404s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:41 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b 1G Sep 11 23:11:41 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:42 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b 1G" returned: 0 in 0.535s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf3476b-ed44-451e-a88e-f47b10208680 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:42 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf3476b-ed44-451e-a88e-f47b10208680 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b Sep 11 23:11:42 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:42 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf3476b-ed44-451e-a88e-f47b10208680 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:42 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b is being set with open permissions: ugo+rw Sep 11 23:11:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:42 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b Sep 11 23:11:42 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:42 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b" returned: 0 in 0.391s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:43 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info Sep 11 23:11:43 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (e785c8be-3747-4d11-be73-fdcef57a49de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe42489b-0533-415f-ac4a-ca65086085e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe42489b-0533-415f-ac4a-ca65086085e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1199068920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9663e38d-8b6a-4335-a724-c6b94d18c752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07fd7904d4045c0862d5a1c735dffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36329d39-629a-4ddd-bb23-b5acf27d9775,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:43Z,use_quota=True,user_id='ec49dd14825448c189410d03050d174e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5275d3b-f9be-47e2-8267-ca3c6b2e4658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5275d3b-f9be-47e2-8267-ca3c6b2e4658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccefe235-c282-48d1-b930-1e0696ed3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccefe235-c282-48d1-b930-1e0696ed3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9663e38d-8b6a-4335-a724-c6b94d18c752', 'volume_name': 'volume-9663e38d-8b6a-4335-a724-c6b94d18c752', 'volume_size': 1, 'snapshot_id': '36329d39-629a-4ddd-bb23-b5acf27d9775'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb89908f-8314-41a7-849b-a1453b1f740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb89908f-8314-41a7-849b-a1453b1f740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a54f2f7-4388-4356-b2ac-aa65ca7a9b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:43 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume 9663e38d-8b6a-4335-a724-c6b94d18c752: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9663e38d-8b6a-4335-a724-c6b94d18c752', 'volume_size': 1, 'snapshot_id': '36329d39-629a-4ddd-bb23-b5acf27d9775'} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:43 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:43 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info is being set with open permissions: ugo+rw Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:43 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info Sep 11 23:11:43 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:43 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.info" returned: 0 in 0.289s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.950s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1803655541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86171970-6cd4-4cbc-8be0-8118d7a17634,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e00bb102f8dd4b4e94fcf70a8156f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:39Z,use_quota=True,user_id='f2b539a2aa2340a3bd24e1ea8735a03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Creating volume 86171970-6cd4-4cbc-8be0-8118d7a17634 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:43 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:43 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 1073741824 Sep 11 23:11:43 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:43 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8522b84e-0862-4a3b-a08f-9eb5c482cc73 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Create snapshot completed successfully Sep 11 23:11:44 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 1073741824" returned: 0 in 0.564s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:44 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 Sep 11 23:11:44 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:44 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.382s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-36329d39-629a-4ddd-bb23-b5acf27d9775-9663e38d-8b6a-4335-a724-c6b94d18c752" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3060d4-99f5-4f5a-a976-e06d30602ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86171970-6cd4-4cbc-8be0-8118d7a17634', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5875161-5bcd-4642-9cc1-2f46cb0d8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-36329d39-629a-4ddd-bb23-b5acf27d9775-9663e38d-8b6a-4335-a724-c6b94d18c752" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating volume 9663e38d-8b6a-4335-a724-c6b94d18c752 from snapshot 36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-9663e38d-8b6a-4335-a724-c6b94d18c752" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:44 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Volume volume-86171970-6cd4-4cbc-8be0-8118d7a17634 (86171970-6cd4-4cbc-8be0-8118d7a17634): created successfully Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5875161-5bcd-4642-9cc1-2f46cb0d8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Flow 'volume_create_manager' (0db0bc90-1ef5-4865-95f9-c5b7176d5578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-9663e38d-8b6a-4335-a724-c6b94d18c752" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] snapshot: 36329d39-629a-4ddd-bb23-b5acf27d9775, volume: 9663e38d-8b6a-4335-a724-c6b94d18c752, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:11:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-37a2a2f1-4410-4f27-8a42-640bb9a76ecd tempest-VolumesListTestJSON-1370251748 None] Created volume successfully. Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7819f8-07d2-4f4a-b8a2-e5f0ec024d7f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (88296d60-e8bd-49fd-ab80-35dce53d4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457487a0-888a-4479-aff1-906b681734cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 Sep 11 23:11:44 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457487a0-888a-4479-aff1-906b681734cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353023924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48771d48-e522-4f60-a76c-f2955eadeb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:45Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcaa94e-7d69-4e64-b6f0-aabb778cd408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcaa94e-7d69-4e64-b6f0-aabb778cd408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df64000a-c7fe-4241-a58d-374058620bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df64000a-c7fe-4241-a58d-374058620bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48771d48-e522-4f60-a76c-f2955eadeb7b', 'volume_name': 'volume-48771d48-e522-4f60-a76c-f2955eadeb7b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef218029-2d81-44bd-aac8-828e0f1e26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef218029-2d81-44bd-aac8-828e0f1e26c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa25085-bee2-4b55-b0f7-392f7ec459c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume 48771d48-e522-4f60-a76c-f2955eadeb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48771d48-e522-4f60-a76c-f2955eadeb7b', 'volume_size': 1} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:45 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775" returned: 0 in 0.511s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[601aa6f0-624f-4d64-af57-ee27608c55c6]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:45 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac Sep 11 23:11:45 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (a29ff6af-c14e-4300-948a-4655d3c6afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9bb6ba-04c0-42f6-9668-cfcd421c8e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9bb6ba-04c0-42f6-9668-cfcd421c8e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226528446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3771ad27-1116-4de2-8ffc-bce7f1d6fbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:45Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6dbb11-5dc2-47d4-b169-80236c256dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6dbb11-5dc2-47d4-b169-80236c256dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6778c4ed-c2b7-4eb1-9079-5f4cb979efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6778c4ed-c2b7-4eb1-9079-5f4cb979efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3771ad27-1116-4de2-8ffc-bce7f1d6fbc7', 'volume_name': 'volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b2b0a4-aaa3-465c-bfeb-e7f5b087c1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b2b0a4-aaa3-465c-bfeb-e7f5b087c1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79229ea4-39a6-4d9a-9926-860e184bad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:45 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume 3771ad27-1116-4de2-8ffc-bce7f1d6fbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7', 'volume_size': 1} Sep 11 23:11:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:46 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" returned: 0 in 0.680s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:46 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 Sep 11 23:11:46 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Flow 'volume_create_manager' (91d7911d-4e06-443f-b31d-aa509cffa426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a68edae-34be-4cf6-a5df-59dd8358d722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a68edae-34be-4cf6-a5df-59dd8358d722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1571073158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6aefeb-98c0-4721-8587-ed74846a32f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e00bb102f8dd4b4e94fcf70a8156f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:46Z,use_quota=True,user_id='f2b539a2aa2340a3bd24e1ea8735a03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac25c695-e73a-4099-8674-5a237b060e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac25c695-e73a-4099-8674-5a237b060e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c98be52-08fa-4ff7-b1c2-df9a547d6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c98be52-08fa-4ff7-b1c2-df9a547d6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6aefeb-98c0-4721-8587-ed74846a32f4', 'volume_name': 'volume-bd6aefeb-98c0-4721-8587-ed74846a32f4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe86a8b-b8d3-4fac-ab84-5b7496b59ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe86a8b-b8d3-4fac-ab84-5b7496b59ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b89ba24-e59e-4e3c-8769-845b290b4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Volume bd6aefeb-98c0-4721-8587-ed74846a32f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6aefeb-98c0-4721-8587-ed74846a32f4', 'volume_size': 1} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (f91fd7ac-57ca-46bb-8f38-f5d79996be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c469f5f5-ad01-4afc-bef5-8b2c904a9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c469f5f5-ad01-4afc-bef5-8b2c904a9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503855996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aa9e0d-504a-48b5-96b4-6aee9afd9b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:46Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77b51e2-b8d0-4950-a70a-2dc37aef5bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77b51e2-b8d0-4950-a70a-2dc37aef5bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22d7268-67f1-4b54-aff5-806941f4b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22d7268-67f1-4b54-aff5-806941f4b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aa9e0d-504a-48b5-96b4-6aee9afd9b62', 'volume_name': 'volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5181d39-2066-430d-a39e-1bd041a7bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5181d39-2066-430d-a39e-1bd041a7bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e6eab-d9d0-4c17-8d56-9a27f381db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume d0aa9e0d-504a-48b5-96b4-6aee9afd9b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62', 'volume_size': 1} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (5b9b1391-fa7b-4f6a-b1f4-4c11c361585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d0846a-08ba-4a13-bb21-fd6e521bff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d0846a-08ba-4a13-bb21-fd6e521bff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657035197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fca935e-4f5e-4753-9713-02a8d1d18bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:47Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf75239-f02c-4ae4-bb1a-cf49c80fff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf75239-f02c-4ae4-bb1a-cf49c80fff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2d3ddc-0f39-4f77-9412-c0b55d5046f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2d3ddc-0f39-4f77-9412-c0b55d5046f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fca935e-4f5e-4753-9713-02a8d1d18bdc', 'volume_name': 'volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3851554e-03f4-4b92-afdb-e8d2f5f6ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3851554e-03f4-4b92-afdb-e8d2f5f6ded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4b43e8-ea72-4033-90e1-45dc443343cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume 0fca935e-4f5e-4753-9713-02a8d1d18bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc', 'volume_size': 1} Sep 11 23:11:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:47 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (c0e4ed2c-3e75-4d71-904c-afd9c6caba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7026af41-831e-4c1f-8afb-ed99c149a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7026af41-831e-4c1f-8afb-ed99c149a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918525090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c8bc3b-52b9-4544-b3c7-99aeb410d919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:48Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45c5ab6-1046-4a25-9281-60ae13434970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45c5ab6-1046-4a25-9281-60ae13434970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29eca7d4-7ba2-4c39-8875-79e21743d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29eca7d4-7ba2-4c39-8875-79e21743d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c8bc3b-52b9-4544-b3c7-99aeb410d919', 'volume_name': 'volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f831352-dcce-491f-8773-aaee0e630315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f831352-dcce-491f-8773-aaee0e630315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb322e6c-44ac-4e58-a5a4-b074ee788116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:48 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume 01c8bc3b-52b9-4544-b3c7-99aeb410d919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919', 'volume_size': 1} Sep 11 23:11:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:52 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752" returned: 0 in 6.444s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:11:52 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Converted 1024.00 MB image at 158.87 MB/s Sep 11 23:11:52 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 is being set with open permissions: ugo+rw Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:52 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 Sep 11 23:11:52 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:52 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-9663e38d-8b6a-4335-a724-c6b94d18c752" released by "_copy_volume_from_snapshot" :: held 8.022s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-36329d39-629a-4ddd-bb23-b5acf27d9775-9663e38d-8b6a-4335-a724-c6b94d18c752" released by "_create_volume_from_snapshot" :: held 8.142s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.187s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.703s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353023924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48771d48-e522-4f60-a76c-f2955eadeb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:45Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating volume 48771d48-e522-4f60-a76c-f2955eadeb7b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:52 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:52 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b 1073741824 Sep 11 23:11:52 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a54f2f7-4388-4356-b2ac-aa65ca7a9b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9663e38d-8b6a-4335-a724-c6b94d18c752', 'volume_size': 1, 'snapshot_id': '36329d39-629a-4ddd-bb23-b5acf27d9775'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917a94c3-9aa5-456d-9cc8-673f5550303f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:52 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Volume volume-9663e38d-8b6a-4335-a724-c6b94d18c752 (9663e38d-8b6a-4335-a724-c6b94d18c752): created successfully Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917a94c3-9aa5-456d-9cc8-673f5550303f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Flow 'volume_create_manager' (e785c8be-3747-4d11-be73-fdcef57a49de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-263b8925-a565-4d67-8b3b-7d4481a14c11 tempest-VolumesSnapshotTestJSON-1417139440 None] Created volume successfully. Sep 11 23:11:53 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b 1073741824" returned: 0 in 0.418s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:53 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b Sep 11 23:11:53 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-9663e38d-8b6a-4335-a724-c6b94d18c752-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-9663e38d-8b6a-4335-a724-c6b94d18c752-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:53 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.687s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226528446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3771ad27-1116-4de2-8ffc-bce7f1d6fbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:45Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating volume 3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:53 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:53 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 1073741824 Sep 11 23:11:53 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa25085-bee2-4b55-b0f7-392f7ec459c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48771d48-e522-4f60-a76c-f2955eadeb7b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40324ae2-56ed-4f49-acdd-6bee4264efe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-9663e38d-8b6a-4335-a724-c6b94d18c752" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:53 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume volume-48771d48-e522-4f60-a76c-f2955eadeb7b (48771d48-e522-4f60-a76c-f2955eadeb7b): created successfully Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40324ae2-56ed-4f49-acdd-6bee4264efe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (88296d60-e8bd-49fd-ab80-35dce53d4f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-9663e38d-8b6a-4335-a724-c6b94d18c752" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:53 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-36d06270-cf18-4f0d-97bf-edf42121e6da tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created volume successfully. Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe779e4-6a4a-4207-a405-e861cb9fffe3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:53 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 Sep 11 23:11:53 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:53 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 1073741824" returned: 0 in 0.424s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 Sep 11 23:11:54 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752" returned: 0 in 0.374s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752 Sep 11 23:11:54 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7" returned: 0 in 0.262s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.921s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1571073158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6aefeb-98c0-4721-8587-ed74846a32f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e00bb102f8dd4b4e94fcf70a8156f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:46Z,use_quota=True,user_id='f2b539a2aa2340a3bd24e1ea8735a03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Creating volume bd6aefeb-98c0-4721-8587-ed74846a32f4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:54 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79229ea4-39a6-4d9a-9926-860e184bad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:54 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 1073741824 Sep 11 23:11:54 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6332ca63-a685-4837-813c-5b7741b41028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9663e38d-8b6a-4335-a724-c6b94d18c752" returned: 0 in 0.297s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-9663e38d-8b6a-4335-a724-c6b94d18c752" released by "delete_volume" :: held 0.727s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:54 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 (3771ad27-1116-4de2-8ffc-bce7f1d6fbc7): created successfully Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6332ca63-a685-4837-813c-5b7741b41028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (a29ff6af-c14e-4300-948a-4655d3c6afa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-50a0b3bf-5d83-4e09-842f-c4f5a095e390 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created volume successfully. Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['ead2564f-11aa-456e-85f6-d0935a6eeca3', 'd715371d-5aa1-428c-9174-c528bda60295', 'dfe26351-816e-4f18-be0b-a7471696773d', '4ef3832a-b774-4f9c-9fc7-ea114ed74804'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:54 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-36329d39-629a-4ddd-bb23-b5acf27d9775-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-36329d39-629a-4ddd-bb23-b5acf27d9775-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-36329d39-629a-4ddd-bb23-b5acf27d9775" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:54 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-36329d39-629a-4ddd-bb23-b5acf27d9775" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Deleting offline snapshot 36329d39-629a-4ddd-bb23-b5acf27d9775 of volume d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] snapshot_file for this snap is: volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Deleted volume successfully. Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cf7248-b3f4-4892-ba37-339579be7931]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:54 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 1073741824" returned: 0 in 0.531s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2651a18c-22c3-4331-b23c-2c3dcd2ddc26 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-9663e38d-8b6a-4335-a724-c6b94d18c752-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 Sep 11 23:11:54 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 Sep 11 23:11:54 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:55 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.528s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503855996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aa9e0d-504a-48b5-96b4-6aee9afd9b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:46Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating volume d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:55 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b89ba24-e59e-4e3c-8769-845b290b4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6aefeb-98c0-4721-8587-ed74846a32f4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:55 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 1073741824 Sep 11 23:11:55 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e32f39-65a4-4446-871a-a471753b3f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Volume volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 (bd6aefeb-98c0-4721-8587-ed74846a32f4): created successfully Sep 11 23:11:55 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e32f39-65a4-4446-871a-a471753b3f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Flow 'volume_create_manager' (91d7911d-4e06-443f-b31d-aa509cffa426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775" returned: 0 in 0.379s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6c4ccd4c-81ec-475b-944e-300cd191c40c tempest-VolumesListTestJSON-1370251748 None] Created volume successfully. Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7750f-03ba-4977-a978-f889d69d381f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:55 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac Sep 11 23:11:55 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:55 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 1073741824" returned: 0 in 0.557s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:55 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 Sep 11 23:11:55 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:55 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" returned: 0 in 0.626s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:55 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 Sep 11 23:11:55 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:56 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62" returned: 0 in 0.286s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.958s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657035197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fca935e-4f5e-4753-9713-02a8d1d18bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:47Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating volume 0fca935e-4f5e-4753-9713-02a8d1d18bdc {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:56 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e6eab-d9d0-4c17-8d56-9a27f381db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:56 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc 1073741824 Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3627e6ca-11ff-4393-b1e1-d525258dac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:56 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 (d0aa9e0d-504a-48b5-96b4-6aee9afd9b62): created successfully Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3627e6ca-11ff-4393-b1e1-d525258dac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (f91fd7ac-57ca-46bb-8f38-f5d79996be33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-650a3915-7f4c-440a-8097-49a6511c3bee tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created volume successfully. Sep 11 23:11:56 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775" returned: 0 in 0.385s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:56 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775 Sep 11 23:11:56 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:56 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac.36329d39-629a-4ddd-bb23-b5acf27d9775" returned: 0 in 0.253s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-36329d39-629a-4ddd-bb23-b5acf27d9775" released by "_delete_snapshot" :: held 1.771s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" released by "delete_snapshot" :: held 1.802s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:56 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc 1073741824" returned: 0 in 0.577s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:56 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc Sep 11 23:11:56 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['892d1c6c-3376-41a0-b84e-595f234b2144', '671ba69a-ef15-44ab-9a7f-63e4fad73790', 'd8a27693-c4a5-4bb2-afec-e630ebf08e9b', '79ef4ecc-69d2-4786-abf6-e47e725d5868'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Delete snapshot completed successfully. Sep 11 23:11:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-065597b6-0994-49f2-b562-b4e8ca4bf38d tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-36329d39-629a-4ddd-bb23-b5acf27d9775-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:57 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.788s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918525090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c8bc3b-52b9-4544-b3c7-99aeb410d919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff415c070b14b3481f45368063b29d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:48Z,use_quota=True,user_id='a064fb94673546c9b3da0aca29b2d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Creating volume 01c8bc3b-52b9-4544-b3c7-99aeb410d919 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:57 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4b43e8-ea72-4033-90e1-45dc443343cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509080d7-3f3d-43d0-ac00-a6a4a3f623ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:57 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 1073741824 Sep 11 23:11:57 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc (0fca935e-4f5e-4753-9713-02a8d1d18bdc): created successfully Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509080d7-3f3d-43d0-ac00-a6a4a3f623ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (5b9b1391-fa7b-4f6a-b1f4-4c11c361585e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-62edeba0-58ce-4606-9e96-3fc9f1280caa tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created volume successfully. Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f0bc7-462c-4cee-a9e7-6e1772bed26a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:57 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac Sep 11 23:11:57 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:57 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 1073741824" returned: 0 in 0.515s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:57 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:57 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac Sep 11 23:11:57 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:57 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 Sep 11 23:11:57 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "cinder-bd6aefeb-98c0-4721-8587-ed74846a32f4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-bd6aefeb-98c0-4721-8587-ed74846a32f4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:57 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" returned: 0 in 0.286s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac" released by "delete_volume" :: held 0.748s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "cinder-quobyte-bd6aefeb-98c0-4721-8587-ed74846a32f4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-quobyte-bd6aefeb-98c0-4721-8587-ed74846a32f4" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:57 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d10404-b38d-4275-9857-d8ff3e9e8d2e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb322e6c-44ac-4e58-a5a4-b074ee788116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce3f70a-9892-4733-8b2c-f981c03eecf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Volume volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 (01c8bc3b-52b9-4544-b3c7-99aeb410d919): created successfully Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce3f70a-9892-4733-8b2c-f981c03eecf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Flow 'volume_create_manager' (c0e4ed2c-3e75-4d71-904c-afd9c6caba39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['20b3f92f-9c3e-4cb9-a9c8-7bf79ecbdf22', 'e3831022-ae36-4a87-b8f8-f3c804f6f238', 'd401fbca-2f55-4273-8370-970b4d2b01ac', '23df01d3-f514-42e2-bd56-d3321aa0ea8e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-05412cc3-cc06-4920-8ede-3dc213913a0b tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created volume successfully. Sep 11 23:11:58 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 Sep 11 23:11:58 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:58 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-3c63e4c5-d25c-432c-bde4-248528d0039e-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-3c63e4c5-d25c-432c-bde4-248528d0039e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:58 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4" returned: 0 in 0.445s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "cinder-quobyte-3c63e4c5-d25c-432c-bde4-248528d0039e" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:58 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4 Sep 11 23:11:58 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-3c63e4c5-d25c-432c-bde4-248528d0039e" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:58 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.383s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Deleted volume successfully. Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2917b5a-29d4-406d-9b59-c58c050422b1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9bfaa643-651f-4219-9dd8-3a87365171ad tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-d86a55f1-2bb5-44d6-a31d-a0a8a1eb91ac-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:58 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e Sep 11 23:11:58 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bd6aefeb-98c0-4721-8587-ed74846a32f4" returned: 0 in 0.312s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-quobyte-bd6aefeb-98c0-4721-8587-ed74846a32f4" released by "delete_volume" :: held 0.803s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Created reservations ['46765a1e-618e-40fa-b178-087c16f9c195', '30c6796c-d314-48a9-b201-07ed24fa95ca', '31b305d5-5e49-4b85-9ec9-192fb17c67e4', '3f086ecf-c9e5-469c-814c-005baa246c37'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:58 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-01c8bc3b-52b9-4544-b3c7-99aeb410d919-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-01c8bc3b-52b9-4544-b3c7-99aeb410d919-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:59 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e" returned: 0 in 0.592s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e Sep 11 23:11:59 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:59 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "cinder-86171970-6cd4-4cbc-8be0-8118d7a17634-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:59 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-01c8bc3b-52b9-4544-b3c7-99aeb410d919" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.339s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Deleted volume successfully. Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-86171970-6cd4-4cbc-8be0-8118d7a17634-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-01c8bc3b-52b9-4544-b3c7-99aeb410d919" acquired by "delete_volume" :: waited 0.095s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29f961-a117-4500-a41a-cc236f890c1b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-95c65d05-0764-4ca6-ae79-736407b9fe58 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-bd6aefeb-98c0-4721-8587-ed74846a32f4-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "cinder-quobyte-86171970-6cd4-4cbc-8be0-8118d7a17634" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-quobyte-86171970-6cd4-4cbc-8be0-8118d7a17634" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30096fd-ca3f-44a1-b40d-b2f51eed07c8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.423s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:11:59 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 Sep 11 23:11:59 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 Sep 11 23:11:59 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c63e4c5-d25c-432c-bde4-248528d0039e" returned: 0 in 0.543s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-quobyte-3c63e4c5-d25c-432c-bde4-248528d0039e" released by "delete_volume" :: held 1.218s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Created reservations ['fbaeaecc-3813-4483-a39b-1a9d3dba5fbb', 'dc751930-9caf-4ce4-afd8-5fb1fd5bc17a', '72b32254-e53c-4057-a24c-954303109380', '197724f7-eca6-46bf-8c5f-757b19b4a0a3'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:11:59 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919" returned: 0 in 0.527s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919 Sep 11 23:11:59 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634" returned: 0 in 0.472s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634 Sep 11 23:12:00 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.270s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Deleted volume successfully. Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-373de1dd-72e5-4d15-85ed-24100cf886c7 tempest-VolumesSnapshotTestJSON-1417139440 None] Lock "cinder-3c63e4c5-d25c-432c-bde4-248528d0039e-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:00 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-01c8bc3b-52b9-4544-b3c7-99aeb410d919" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-01c8bc3b-52b9-4544-b3c7-99aeb410d919" released by "delete_volume" :: held 0.946s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:00 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-86171970-6cd4-4cbc-8be0-8118d7a17634" returned: 0 in 0.311s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-quobyte-86171970-6cd4-4cbc-8be0-8118d7a17634" released by "delete_volume" :: held 0.857s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['148094a3-7260-4fc2-a9c2-6bb127f0525c', '27016394-462f-42e1-b1dd-f1bf9e54cafd', 'f5aaa29e-54e0-400c-a8fe-6965b1d844ec', 'a5f926bd-fca2-4438-88ca-c64191f99567'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Created reservations ['7b476f6e-914d-4145-8084-ff0f69296b92', 'd1cc8b07-d2d3-4e4c-bd2c-0387e646bd13', 'ccad72bc-c808-4cbd-a3b0-0f62c7e7ebdf', '08f37e0e-e471-45e7-824b-22e419441dbe'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:00 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:00 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleted volume successfully. Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-4a681c5d-7110-42bb-b53e-df7fab198854 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-01c8bc3b-52b9-4544-b3c7-99aeb410d919-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:00 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Deleted volume successfully. Sep 11 23:12:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed53a31-8b6b-49f9-b7c6-8338b113647f tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-86171970-6cd4-4cbc-8be0-8118d7a17634-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-0fca935e-4f5e-4753-9713-02a8d1d18bdc-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-0fca935e-4f5e-4753-9713-02a8d1d18bdc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-0fca935e-4f5e-4753-9713-02a8d1d18bdc" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-0fca935e-4f5e-4753-9713-02a8d1d18bdc" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25067ce-213b-40f6-ba6d-83c2f71ab49b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc Sep 11 23:12:01 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "cinder-61f6b241-cae1-478b-ab82-c426ef6c9bd4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-61f6b241-cae1-478b-ab82-c426ef6c9bd4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "cinder-quobyte-61f6b241-cae1-478b-ab82-c426ef6c9bd4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-quobyte-61f6b241-cae1-478b-ab82-c426ef6c9bd4" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64811f-27dd-4125-b26d-e367c3f15371]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 Sep 11 23:12:01 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc" returned: 0 in 0.437s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc Sep 11 23:12:01 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4" returned: 0 in 0.390s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0fca935e-4f5e-4753-9713-02a8d1d18bdc" returned: 0 in 0.266s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:02 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4 Sep 11 23:12:02 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-0fca935e-4f5e-4753-9713-02a8d1d18bdc" released by "delete_volume" :: held 0.774s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['0901f9f2-c414-47f1-a026-f5a2529d69b1', '7b1c5c03-853c-4b16-a8dc-5e5901148799', 'ea5a0a1c-0dce-471b-a959-13189062c639', '8080d815-8113-4d52-a5b7-6692e5c6c50c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:02 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-61f6b241-cae1-478b-ab82-c426ef6c9bd4" returned: 0 in 0.298s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-quobyte-61f6b241-cae1-478b-ab82-c426ef6c9bd4" released by "delete_volume" :: held 0.739s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Created reservations ['80da2822-dc66-4fe5-9e12-2b4a1d316ce8', '8aae487a-64be-4621-892f-bb26eb349985', 'c41c0daa-09d9-46bc-9300-1e76375e50bd', '681ce84f-380d-403a-97b9-175905284312'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:02 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:02 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:02 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.318s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleted volume successfully. Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9accef-f5c2-4a03-8093-c6e8ddc351e3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-375f9a18-5cee-40dd-a3c8-c710a69205d4 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-0fca935e-4f5e-4753-9713-02a8d1d18bdc-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 Sep 11 23:12:02 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.334s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Deleted volume successfully. Sep 11 23:12:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fef6876-c624-4efc-87ce-3a3eabc1e442 tempest-VolumesListTestJSON-1370251748 None] Lock "cinder-61f6b241-cae1-478b-ab82-c426ef6c9bd4-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:03 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62" returned: 0 in 0.487s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:03 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62 Sep 11 23:12:03 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:03 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62" returned: 0 in 0.425s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62" released by "delete_volume" :: held 0.978s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['621060bc-2123-496c-b3fa-e87ee77481ea', '8851172c-0e18-4c19-92eb-719438d8e085', '06405684-58e6-49a1-adb1-86b402730c6c', 'b99073bb-9998-433c-ad14-cf3f5293a793'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:03 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:03 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:04 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.291s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleted volume successfully. Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0b3b6070-96b1-4720-ad1e-d64d06100848 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-d0aa9e0d-504a-48b5-96b4-6aee9afd9b62-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-e81346c4-a89c-4552-99db-db1979bbbf97 req-1f2808fa-69a3-4a9a-9b5b-2c4cafb11edb tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-e81346c4-a89c-4552-99db-db1979bbbf97 req-1f2808fa-69a3-4a9a-9b5b-2c4cafb11edb tempest-TestStampPattern-1193458763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-e81346c4-a89c-4552-99db-db1979bbbf97 req-1f2808fa-69a3-4a9a-9b5b-2c4cafb11edb tempest-TestStampPattern-1193458763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-e81346c4-a89c-4552-99db-db1979bbbf97 req-1f2808fa-69a3-4a9a-9b5b-2c4cafb11edb tempest-TestStampPattern-1193458763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-96ca137a-f6d7-4f70-b16b-d60428847685', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d017f2c-b997-4684-862a-6ddb388ecfb9', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-e81346c4-a89c-4552-99db-db1979bbbf97 req-1f2808fa-69a3-4a9a-9b5b-2c4cafb11edb tempest-TestStampPattern-1193458763 None] attachment_update completed successfully. Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d135498-8cf7-4976-b247-0ef6729e8f98]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:05 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 Sep 11 23:12:05 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:05 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7" returned: 0 in 0.480s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:05 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7 Sep 11 23:12:05 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:05 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7" returned: 0 in 0.438s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7" released by "delete_volume" :: held 0.978s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['256bc10f-4808-47c2-bbc7-570fc5d2995f', '030993ad-0f5a-41ce-a7dc-303c3f332d8b', 'cfeb13d7-7663-496b-8797-939d2c73acbc', '32b246d0-a610-40cb-9c99-89445f79c971'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:06 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:06 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:06 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.308s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleted volume successfully. Sep 11 23:12:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-31ef5765-4c5a-46f6-9401-99d105851d0f tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-3771ad27-1116-4de2-8ffc-bce7f1d6fbc7-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-48771d48-e522-4f60-a76c-f2955eadeb7b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-48771d48-e522-4f60-a76c-f2955eadeb7b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-48771d48-e522-4f60-a76c-f2955eadeb7b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-48771d48-e522-4f60-a76c-f2955eadeb7b" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9a516-4c51-4ce6-9065-62b75feb10b4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:07 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b Sep 11 23:12:07 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:07 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b" returned: 0 in 0.465s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:07 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b Sep 11 23:12:07 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:08 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-48771d48-e522-4f60-a76c-f2955eadeb7b" returned: 0 in 0.304s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-48771d48-e522-4f60-a76c-f2955eadeb7b" released by "delete_volume" :: held 0.837s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['4c407c35-21f1-4436-9371-cc9e52842e4b', '9a39d736-bce4-457f-9d6c-a99fbfaf1d00', '6d25ae0c-59bc-439d-b6ca-6438361f9057', '4ac2b8c3-d578-4097-99c4-42b0a692c176'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:08 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:08 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-b833ffb3-25e7-49b8-9c89-4baa53b4b50b-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-b833ffb3-25e7-49b8-9c89-4baa53b4b50b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-ebf3476b-ed44-451e-a88e-f47b10208680" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-ebf3476b-ed44-451e-a88e-f47b10208680" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-b833ffb3-25e7-49b8-9c89-4baa53b4b50b" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-b833ffb3-25e7-49b8-9c89-4baa53b4b50b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleting offline snapshot b833ffb3-25e7-49b8-9c89-4baa53b4b50b of volume ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] snapshot_file for this snap is: volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eccf38-06e2-4f21-9054-21185621946f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:08 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.456s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:08 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b Sep 11 23:12:08 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleted volume successfully. Sep 11 23:12:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dcc604b0-44e4-4f79-950d-d65296b25b9e tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-48771d48-e522-4f60-a76c-f2955eadeb7b-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:09 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b" returned: 0 in 0.541s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebf3476b-ed44-451e-a88e-f47b10208680(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:12:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d600a6-b3f2-4b03-83b6-fe64a9a9a7ed]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:09 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 Sep 11 23:12:09 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:09 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680" returned: 0 in 0.505s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:09 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b Sep 11 23:12:09 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:10 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b" returned: 0 in 0.452s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:10 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b Sep 11 23:12:10 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Flow 'volume_create_manager' (df838d1e-28dc-4967-a25c-c76e319ea324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45df14d2-e3f3-437c-a549-481eda20f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45df14d2-e3f3-437c-a549-481eda20f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1174506923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca45a45-faf0-427f-a5a1-9395507aebdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c3dea745dc455789eaf5868d6a1f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:10Z,use_quota=True,user_id='6cefb154c3f2409bb4b94c9a9355a712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d114740-93ec-44ed-a173-c0eb4cebcd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d114740-93ec-44ed-a173-c0eb4cebcd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31048e2-c12b-4054-bd90-9a24c9b610b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31048e2-c12b-4054-bd90-9a24c9b610b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca45a45-faf0-427f-a5a1-9395507aebdb', 'volume_name': 'volume-0ca45a45-faf0-427f-a5a1-9395507aebdb', 'volume_size': 2}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e39b2a8-11a0-4426-8fd2-2c33c09464ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e39b2a8-11a0-4426-8fd2-2c33c09464ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3d2e11-3c89-4e4a-bd7c-e5b6263e8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Volume 0ca45a45-faf0-427f-a5a1-9395507aebdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca45a45-faf0-427f-a5a1-9395507aebdb', 'volume_size': 2} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1174506923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca45a45-faf0-427f-a5a1-9395507aebdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c3dea745dc455789eaf5868d6a1f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:10Z,use_quota=True,user_id='6cefb154c3f2409bb4b94c9a9355a712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Creating volume 0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:10 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb 2147483648 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:10 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb 2147483648 Sep 11 23:12:10 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:10 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680.b833ffb3-25e7-49b8-9c89-4baa53b4b50b" returned: 0 in 0.485s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-b833ffb3-25e7-49b8-9c89-4baa53b4b50b" released by "_delete_snapshot" :: held 2.163s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-ebf3476b-ed44-451e-a88e-f47b10208680" released by "delete_snapshot" :: held 2.207s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['8201dc07-0fb9-4161-84e0-9bf85340b3f5', '125dce98-c39d-43e6-a8de-03bd6c8486da', '48f26362-524b-4e6a-945f-d0c62a433fdb', '9f9cb789-0de7-4e78-90b1-e69df533569b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Delete snapshot completed successfully. Sep 11 23:12:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-308a0af2-581c-4ec0-b891-e36ad63c88e2 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-b833ffb3-25e7-49b8-9c89-4baa53b4b50b-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-a8cb14fc-1104-4ea8-b975-c8b11e34502a req-1ee920df-21ff-47c2-92a3-ada7fcc4d2c7 tempest-TestStampPattern-1193458763 None] Terminate volume connection completed successfully. Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-a8cb14fc-1104-4ea8-b975-c8b11e34502a req-1ee920df-21ff-47c2-92a3-ada7fcc4d2c7 tempest-TestStampPattern-1193458763 None] Deleting attachment 6d017f2c-b997-4684-862a-6ddb388ecfb9. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:12:11 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb 2147483648" returned: 0 in 0.657s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:11 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb Sep 11 23:12:11 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:11 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb" returned: 0 in 0.241s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3d2e11-3c89-4e4a-bd7c-e5b6263e8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca45a45-faf0-427f-a5a1-9395507aebdb', 'volume_size': 2}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280ac7d9-fb8b-4812-bea0-bf92140c3974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Volume volume-0ca45a45-faf0-427f-a5a1-9395507aebdb (0ca45a45-faf0-427f-a5a1-9395507aebdb): created successfully Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280ac7d9-fb8b-4812-bea0-bf92140c3974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Flow 'volume_create_manager' (df838d1e-28dc-4967-a25c-c76e319ea324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5f006e5e-0b78-41b2-89d5-0722acc534aa tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Created volume successfully. Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-ebf3476b-ed44-451e-a88e-f47b10208680-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-ebf3476b-ed44-451e-a88e-f47b10208680-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "cinder-quobyte-ebf3476b-ed44-451e-a88e-f47b10208680" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-ebf3476b-ed44-451e-a88e-f47b10208680" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[564f4f82-03d4-4331-aea7-896a476387b5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Creating offline snapshot a382cdd0-8fa7-44e2-97a4-b81563310127 of volume 96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:12:12 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 Sep 11 23:12:12 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b423c8-2331-4072-8e17-f462046cad27]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:12 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 Sep 11 23:12:12 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:12 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680" returned: 0 in 0.549s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:12 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680 Sep 11 23:12:12 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:12 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685" returned: 0 in 0.544s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:12 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 1G Sep 11 23:12:12 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:12 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ebf3476b-ed44-451e-a88e-f47b10208680" returned: 0 in 0.419s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-quobyte-ebf3476b-ed44-451e-a88e-f47b10208680" released by "delete_volume" :: held 1.045s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Created reservations ['896965eb-2a49-4e7e-8bcb-dd80aef39207', '40c56d8c-ef1c-40f7-b708-f28bad43fa8d', '1e167f71-1e4b-4fe3-b2e8-b89076d40cad', '0f74c40b-1f99-4f32-94eb-d273536ae546'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:13 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:13 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:13 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 1G" returned: 0 in 0.597s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ca137a-f6d7-4f70-b16b-d60428847685 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:13 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ca137a-f6d7-4f70-b16b-d60428847685 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 Sep 11 23:12:13 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:13 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.270s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Deleted volume successfully. Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-427f43f8-c495-4bb9-beb5-302177544002 tempest-CreateVolumesFromSnapshotTest-1634079071 None] Lock "cinder-ebf3476b-ed44-451e-a88e-f47b10208680-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:13 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ca137a-f6d7-4f70-b16b-d60428847685 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:13 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 is being set with open permissions: ugo+rw Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:13 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 Sep 11 23:12:13 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:13 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127" returned: 0 in 0.254s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:13 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info Sep 11 23:12:13 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:14 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info" returned: 0 in 0.271s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:14 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info is being set with open permissions: ugo+rw Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:14 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info Sep 11 23:12:14 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:14 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.info" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.612s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Creating offline snapshot a05b31f4-ca08-4e73-a179-15c1ead9ab26 of volume 0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:12:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5e5d16f3-b087-44cb-8b20-325bca0738de tempest-TestStampPattern-1193458763 None] Create snapshot completed successfully Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f3f4f-0083-4ba7-adbc-9accb1a0c4a4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:14 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb Sep 11 23:12:14 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:14 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 2G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:14 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 2G Sep 11 23:12:14 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 2G" returned: 0 in 0.629s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca45a45-faf0-427f-a5a1-9395507aebdb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:15 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca45a45-faf0-427f-a5a1-9395507aebdb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 Sep 11 23:12:15 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca45a45-faf0-427f-a5a1-9395507aebdb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26" returned: 0 in 0.417s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 is being set with open permissions: ugo+rw Sep 11 23:12:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:16 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 Sep 11 23:12:16 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:16 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:16 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info Sep 11 23:12:16 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:16 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:16 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info is being set with open permissions: ugo+rw Sep 11 23:12:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:16 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info Sep 11 23:12:16 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:17 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.info" returned: 0 in 0.362s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d54638ae-9f81-4718-ba41-0e0634556231 tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Create snapshot completed successfully Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "cinder-a05b31f4-ca08-4e73-a179-15c1ead9ab26-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-a05b31f4-ca08-4e73-a179-15c1ead9ab26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "cinder-quobyte-0ca45a45-faf0-427f-a5a1-9395507aebdb" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-quobyte-0ca45a45-faf0-427f-a5a1-9395507aebdb" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "cinder-quobyte-a05b31f4-ca08-4e73-a179-15c1ead9ab26" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-quobyte-a05b31f4-ca08-4e73-a179-15c1ead9ab26" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Deleting offline snapshot a05b31f4-ca08-4e73-a179-15c1ead9ab26 of volume 0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] snapshot_file for this snap is: volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8f29e6-8629-4ff9-80fb-c152d0d8bd88]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:18 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 Sep 11 23:12:18 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:19 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26" returned: 0 in 0.590s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ca45a45-faf0-427f-a5a1-9395507aebdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:12:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fa27e-13de-4206-a6b4-892e461e50cd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:19 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb Sep 11 23:12:19 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:19 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb" returned: 0 in 0.647s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:19 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 Sep 11 23:12:19 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:20 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26" returned: 0 in 0.427s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:20 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26 Sep 11 23:12:20 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:20 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb.a05b31f4-ca08-4e73-a179-15c1ead9ab26" returned: 0 in 0.329s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-quobyte-a05b31f4-ca08-4e73-a179-15c1ead9ab26" released by "_delete_snapshot" :: held 2.187s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-quobyte-0ca45a45-faf0-427f-a5a1-9395507aebdb" released by "delete_snapshot" :: held 2.231s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Created reservations ['d70ffc61-c0f6-41f3-a57d-d4b80cd2f16d', '22a0a49f-3bc9-44c7-91a6-a42c104b6c3b', 'dfb1492e-17cb-45ad-be84-5c42d0a5a059', '398e9d80-5e5e-4fc1-bfaa-5abcdb4b70f9'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:20 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Delete snapshot completed successfully. Sep 11 23:12:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-08223a85-c9b4-4a04-86d6-08bd541f8d9a tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-a05b31f4-ca08-4e73-a179-15c1ead9ab26-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Flow 'volume_create_manager' (5767e8d6-94e3-4443-ac88-926cae095ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c63da62-f4ea-4f53-b198-1f585bcc511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c63da62-f4ea-4f53-b198-1f585bcc511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6469239-679a-48d7-b8e8-ab5272eed9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf2908280f34478bb8b676882499467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:22Z,use_quota=True,user_id='3dd6a95fdda347a2bad496856efa28f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d27c8e-2e0b-40ce-81b4-39f49737ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d27c8e-2e0b-40ce-81b4-39f49737ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813d0516-14bf-47a2-bf4a-2de83c574da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "cinder-0ca45a45-faf0-427f-a5a1-9395507aebdb-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-0ca45a45-faf0-427f-a5a1-9395507aebdb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "cinder-quobyte-0ca45a45-faf0-427f-a5a1-9395507aebdb" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-quobyte-0ca45a45-faf0-427f-a5a1-9395507aebdb" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8538316c-0ef8-441b-9fac-f84d90f8bb37]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813d0516-14bf-47a2-bf4a-2de83c574da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6469239-679a-48d7-b8e8-ab5272eed9ad', 'volume_name': 'volume-d6469239-679a-48d7-b8e8-ab5272eed9ad', 'volume_size': 1, 'image_id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ab33840bf8c1660f5067949ab66b7ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3bf2908280f34478bb8b676882499467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5182fdf422e51b4a6c4ee3d52fde6935c3ebe595c618205cbe9633ff14f626413e0c391f8ce018170a397a3641de96d1c8c5077d821562b37637fc7549c7dbc3', 'id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'created_at': datetime.datetime(2026, 9, 11, 21, 12, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 12, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1/file', 'properties': {}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c2d2ee-666f-4007-a68b-f2290a04e335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:22 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb Sep 11 23:12:22 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c2d2ee-666f-4007-a68b-f2290a04e335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ed4ed1-da66-436f-9848-474c3feedd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:22 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Volume d6469239-679a-48d7-b8e8-ab5272eed9ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6469239-679a-48d7-b8e8-ab5272eed9ad', 'volume_size': 1, 'image_id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ab33840bf8c1660f5067949ab66b7ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3bf2908280f34478bb8b676882499467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5182fdf422e51b4a6c4ee3d52fde6935c3ebe595c618205cbe9633ff14f626413e0c391f8ce018170a397a3641de96d1c8c5077d821562b37637fc7549c7dbc3', 'id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'created_at': datetime.datetime(2026, 9, 11, 21, 12, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 12, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1/file', 'properties': {}}, 'image_service': } Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Trying to clone d6469239-679a-48d7-b8e8-ab5272eed9ad from image 564fd4bb-7c1d-42b8-b79f-77968106c4e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:12:22 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3530ed7-01b7-4c9f-bba2-6709e7a58744]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD Sep 11 23:12:22 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:22 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb" returned: 0 in 0.609s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb Sep 11 23:12:22 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:22 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0ca45a45-faf0-427f-a5a1-9395507aebdb" returned: 0 in 0.355s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:22 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD Sep 11 23:12:22 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-quobyte-0ca45a45-faf0-427f-a5a1-9395507aebdb" released by "delete_volume" :: held 1.081s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Created reservations ['2a722c3b-d7a9-4dfc-819a-24e988b0d760', '4fd702c2-3fd4-4bfe-98a4-f1a791011e11', '94191d3a-eb69-4fc8-9bbf-321768752b43', '9ccaba83-4c80-4442-8d70-57a1709b868c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:23 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:23 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:23 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Temporary image 564fd4bb-7c1d-42b8-b79f-77968106c4e1 is fetched for user 3dd6a95fdda347a2bad496856efa28f0. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[66415f24-fa32-4a4e-9dd4-9d6712da039f]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:23 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.307s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Deleted volume successfully. Sep 11 23:12:23 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD Sep 11 23:12:23 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e4aa774f-afc8-43a3-9a37-2186f131775c tempest-VolumesSnapshotNegativeTestJSON-2133108661 None] Lock "cinder-0ca45a45-faf0-427f-a5a1-9395507aebdb-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:23 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD" returned: 0 in 0.426s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:23 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD Sep 11 23:12:23 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:24 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6469239-679a-48d7-b8e8-ab5272eed9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf2908280f34478bb8b676882499467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:22Z,use_quota=True,user_id='3dd6a95fdda347a2bad496856efa28f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Creating volume d6469239-679a-48d7-b8e8-ab5272eed9ad {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:24 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:24 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad 1073741824 Sep 11 23:12:24 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Flow 'volume_create_manager' (89205a92-d08a-4482-8a06-71028bf3ffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacf43d2-d66b-461f-9b56-e6daa6bd5af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacf43d2-d66b-461f-9b56-e6daa6bd5af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-572089772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bf9482-d1df-4a90-8e07-cbc7de809a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aea575f263149079804842bf273261c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a382cdd0-8fa7-44e2-97a4-b81563310127,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:24Z,use_quota=True,user_id='35ec9e8ed11540daae4a697b3cb54f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f02fbe-ffc7-4509-8c74-00a8fbbca757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f02fbe-ffc7-4509-8c74-00a8fbbca757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f149973-e1e4-4dca-8ed8-89c75242970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f149973-e1e4-4dca-8ed8-89c75242970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9bf9482-d1df-4a90-8e07-cbc7de809a07', 'volume_name': 'volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07', 'volume_size': 1, 'snapshot_id': 'a382cdd0-8fa7-44e2-97a4-b81563310127'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5a7cf1-bb56-410c-aa32-676110d73b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5a7cf1-bb56-410c-aa32-676110d73b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037b51bb-745c-4062-afb8-a503ff8fc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:24 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Volume c9bf9482-d1df-4a90-8e07-cbc7de809a07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07', 'volume_size': 1, 'snapshot_id': 'a382cdd0-8fa7-44e2-97a4-b81563310127'} Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:24 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad 1073741824" returned: 0 in 0.757s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:25 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad Sep 11 23:12:25 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:25 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad" returned: 0 in 0.292s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.883s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-quobyte-a382cdd0-8fa7-44e2-97a4-b81563310127-c9bf9482-d1df-4a90-8e07-cbc7de809a07" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-a382cdd0-8fa7-44e2-97a4-b81563310127-c9bf9482-d1df-4a90-8e07-cbc7de809a07" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Creating volume c9bf9482-d1df-4a90-8e07-cbc7de809a07 from snapshot a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-quobyte-c9bf9482-d1df-4a90-8e07-cbc7de809a07" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Attempting download of 564fd4bb-7c1d-42b8-b79f-77968106c4e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'metadata': {}}])) to volume d6469239-679a-48d7-b8e8-ab5272eed9ad. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-c9bf9482-d1df-4a90-8e07-cbc7de809a07" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] snapshot: a382cdd0-8fa7-44e2-97a4-b81563310127, volume: c9bf9482-d1df-4a90-8e07-cbc7de809a07, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[46efc08d-bd25-42ab-9404-281e4a73c533]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cccf5-02be-4d4b-8f18-2ff39744ff78]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:25 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 Sep 11 23:12:25 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:25 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz Sep 11 23:12:25 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:25 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz" returned: 0 in 0.459s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:25 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127" returned: 0 in 0.510s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96ca137a-f6d7-4f70-b16b-d60428847685(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcb5989-b7e8-42ee-a679-8cfb29a56e50]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:26 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz Sep 11 23:12:26 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:26 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 Sep 11 23:12:26 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:26 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz" returned: 1 in 0.476s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_564fd4bb-7c1d-42b8-b79f-77968106c4e1_uah7x_sz' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2effe6c-c495-49a7-87cc-13a2f158649e]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:26 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD Sep 11 23:12:26 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:26 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:26 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685" returned: 0 in 0.968s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:12:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:27 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 Sep 11 23:12:27 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD Sep 11 23:12:27 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD" returned: 1 in 0.499s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:27 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] 564fd4bb-7c1d-42b8-b79f-77968106c4e1 was raw, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:12:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:27 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad Sep 11 23:12:27 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:28 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad" returned: 0 in 1.144s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:28 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_564fd4bb-7c1d-42b8-b79f-77968106c4e1_s11olp6_devstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:12:28 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:12:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:28 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad 1G Sep 11 23:12:28 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:30 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad 1G" returned: 0 in 1.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Downloaded image 564fd4bb-7c1d-42b8-b79f-77968106c4e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'metadata': {}}])) to volume d6469239-679a-48d7-b8e8-ab5272eed9ad successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Temporary image 564fd4bb-7c1d-42b8-b79f-77968106c4e1 for user 3dd6a95fdda347a2bad496856efa28f0 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Marking volume d6469239-679a-48d7-b8e8-ab5272eed9ad as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Copying metadata from image 564fd4bb-7c1d-42b8-b79f-77968106c4e1 to d6469239-679a-48d7-b8e8-ab5272eed9ad. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Creating volume glance metadata for volume d6469239-679a-48d7-b8e8-ab5272eed9ad backed by image 564fd4bb-7c1d-42b8-b79f-77968106c4e1 with: {'image_id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3ab33840bf8c1660f5067949ab66b7ad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ed4ed1-da66-436f-9848-474c3feedd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6469239-679a-48d7-b8e8-ab5272eed9ad', 'volume_size': 1, 'image_id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ab33840bf8c1660f5067949ab66b7ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3bf2908280f34478bb8b676882499467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5182fdf422e51b4a6c4ee3d52fde6935c3ebe595c618205cbe9633ff14f626413e0c391f8ce018170a397a3641de96d1c8c5077d821562b37637fc7549c7dbc3', 'id': '564fd4bb-7c1d-42b8-b79f-77968106c4e1', 'created_at': datetime.datetime(2026, 9, 11, 21, 12, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 12, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/564fd4bb-7c1d-42b8-b79f-77968106c4e1/file', 'properties': {}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463670fc-3b7b-426e-8511-0fcb20a4a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Volume volume-d6469239-679a-48d7-b8e8-ab5272eed9ad (d6469239-679a-48d7-b8e8-ab5272eed9ad): created successfully Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463670fc-3b7b-426e-8511-0fcb20a4a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Flow 'volume_create_manager' (5767e8d6-94e3-4443-ac88-926cae095ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d6ad234d-9c51-4bcd-a5ae-a9f6a7127dec tempest-VolumeImageDependencyTests-1553084926 None] Created volume successfully. Sep 11 23:12:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Acquiring lock "cinder-d6469239-679a-48d7-b8e8-ab5272eed9ad-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Lock "cinder-d6469239-679a-48d7-b8e8-ab5272eed9ad-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Acquiring lock "cinder-quobyte-d6469239-679a-48d7-b8e8-ab5272eed9ad" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Lock "cinder-quobyte-d6469239-679a-48d7-b8e8-ab5272eed9ad" acquired by "delete_volume" :: waited 0.050s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b45c8e-5204-4946-aba7-097bc300fec8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:31 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad Sep 11 23:12:31 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:32 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad" returned: 0 in 1.424s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:32 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad Sep 11 23:12:32 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:33 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6469239-679a-48d7-b8e8-ab5272eed9ad" returned: 0 in 0.823s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Lock "cinder-quobyte-d6469239-679a-48d7-b8e8-ab5272eed9ad" released by "delete_volume" :: held 2.403s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:33 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Created reservations ['cd7d7313-dd6f-4b62-af45-edeb58dd2028', '4e6fd048-770b-4ff5-bbc5-dbc75044d455', 'd053c0ce-8e87-4975-a182-7bb5d13e4dc8', '94653ed9-bbdb-4ee2-8148-0ac341a5a4fc'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:34 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:34 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:34 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07" returned: 0 in 7.477s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:12:34 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Converted 1024.00 MB image at 136.92 MB/s Sep 11 23:12:34 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 is being set with open permissions: ugo+rw Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:34 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 Sep 11 23:12:34 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:34 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.425s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Deleted volume successfully. Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d3c7d010-4780-49be-968c-e4e1fb099b94 tempest-VolumeImageDependencyTests-1553084926 None] Lock "cinder-d6469239-679a-48d7-b8e8-ab5272eed9ad-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:34 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07" returned: 0 in 0.434s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-c9bf9482-d1df-4a90-8e07-cbc7de809a07" released by "_copy_volume_from_snapshot" :: held 9.539s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-a382cdd0-8fa7-44e2-97a4-b81563310127-c9bf9482-d1df-4a90-8e07-cbc7de809a07" released by "_create_volume_from_snapshot" :: held 9.659s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.687s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037b51bb-745c-4062-afb8-a503ff8fc83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07', 'volume_size': 1, 'snapshot_id': 'a382cdd0-8fa7-44e2-97a4-b81563310127'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8752e6dc-f53f-411d-b592-fe325c1558f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Volume volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 (c9bf9482-d1df-4a90-8e07-cbc7de809a07): created successfully Sep 11 23:12:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8752e6dc-f53f-411d-b592-fe325c1558f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Flow 'volume_create_manager' (89205a92-d08a-4482-8a06-71028bf3ffc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3c19b585-1633-4d49-8764-57781c682ec0 tempest-TestStampPattern-1193458763 None] Created volume successfully. Sep 11 23:12:42 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=141,cinder:INSERT=57,cinder:UPDATE=171,cinder:DELETE=14 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:12:42 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=174,cinder:DELETE=16,cinder:SELECT=137,cinder:INSERT=36 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Flow 'volume_create_manager' (e572891e-f685-4413-93fc-2700377f1f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27f5592-ca7b-4fb2-962a-f529a5def4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27f5592-ca7b-4fb2-962a-f529a5def4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1154413570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4027be5b-0cdb-4285-aa02-c7659b93e996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625aacf1fd9e4e1b8d7c089aaf585703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:46Z,use_quota=True,user_id='3a7a9b0d32b3495aa0c753db49a3ae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f610a6df-3aad-457c-8ba5-289b6ac26c53),volume_type_id=f610a6df-3aad-457c-8ba5-289b6ac26c53)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241f87a6-2fd1-469f-881c-3ccb399c95ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241f87a6-2fd1-469f-881c-3ccb399c95ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f194a8f-1308-4578-87de-c284ce261fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f194a8f-1308-4578-87de-c284ce261fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4027be5b-0cdb-4285-aa02-c7659b93e996', 'volume_name': 'volume-4027be5b-0cdb-4285-aa02-c7659b93e996', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f231ab-c0ad-4b97-9288-d9a0f734ae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f231ab-c0ad-4b97-9288-d9a0f734ae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a4376-8937-4832-86a6-14ca0a1e3841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:46 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume 4027be5b-0cdb-4285-aa02-c7659b93e996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4027be5b-0cdb-4285-aa02-c7659b93e996', 'volume_size': 1} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1154413570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4027be5b-0cdb-4285-aa02-c7659b93e996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625aacf1fd9e4e1b8d7c089aaf585703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:46Z,use_quota=True,user_id='3a7a9b0d32b3495aa0c753db49a3ae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f610a6df-3aad-457c-8ba5-289b6ac26c53),volume_type_id=f610a6df-3aad-457c-8ba5-289b6ac26c53)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Creating volume 4027be5b-0cdb-4285-aa02-c7659b93e996 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:46 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:46 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 1073741824 Sep 11 23:12:46 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Flow 'volume_create_manager' (5341756b-c73a-47fe-846d-ab6d33a1d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd8b899-f0b3-4a93-b00b-99a0e7615021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd8b899-f0b3-4a93-b00b-99a0e7615021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-409635660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fa6e6d-0d89-4c51-9d3d-28e49bab9361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625aacf1fd9e4e1b8d7c089aaf585703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:47Z,use_quota=True,user_id='3a7a9b0d32b3495aa0c753db49a3ae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(356e5a83-c36a-4198-9b86-c8cd2d3927ff),volume_type_id=356e5a83-c36a-4198-9b86-c8cd2d3927ff)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de47e83-bd7b-4de3-8022-de5787f15d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de47e83-bd7b-4de3-8022-de5787f15d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370184e0-e9ba-42f7-b8c3-f6199ebdd624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370184e0-e9ba-42f7-b8c3-f6199ebdd624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7fa6e6d-0d89-4c51-9d3d-28e49bab9361', 'volume_name': 'volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a135bca-c6b3-45ca-862f-57c963009363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a135bca-c6b3-45ca-862f-57c963009363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfefd402-0581-4ffb-b640-b0170f0cf16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume a7fa6e6d-0d89-4c51-9d3d-28e49bab9361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361', 'volume_size': 1} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:47 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 1073741824" returned: 0 in 1.005s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:47 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 Sep 11 23:12:47 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:47 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996" returned: 0 in 0.513s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-409635660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fa6e6d-0d89-4c51-9d3d-28e49bab9361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625aacf1fd9e4e1b8d7c089aaf585703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:47Z,use_quota=True,user_id='3a7a9b0d32b3495aa0c753db49a3ae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(356e5a83-c36a-4198-9b86-c8cd2d3927ff),volume_type_id=356e5a83-c36a-4198-9b86-c8cd2d3927ff)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Creating volume a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.083s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:48 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a4376-8937-4832-86a6-14ca0a1e3841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4027be5b-0cdb-4285-aa02-c7659b93e996', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff463ad2-00e0-4ee9-9b4e-435ebfffb8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:48 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 1073741824 Sep 11 23:12:48 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Flow 'volume_create_manager' (cef3a3af-fc7d-48e5-bb5e-c4643da82733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbb62a0-8cdf-4bdb-9a08-77a3e4fe507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:48 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume volume-4027be5b-0cdb-4285-aa02-c7659b93e996 (4027be5b-0cdb-4285-aa02-c7659b93e996): created successfully Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff463ad2-00e0-4ee9-9b4e-435ebfffb8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Flow 'volume_create_manager' (e572891e-f685-4413-93fc-2700377f1f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-824eba63-d4fd-46e1-aafd-514fc11aa6ee tempest-TestInstancesWithCinderVolumes-1823265745 None] Created volume successfully. Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbb62a0-8cdf-4bdb-9a08-77a3e4fe507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1144844245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53b74b3-837e-4ed4-8589-32f4efa544ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625aacf1fd9e4e1b8d7c089aaf585703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:48Z,use_quota=True,user_id='3a7a9b0d32b3495aa0c753db49a3ae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ef57f3e-e710-479f-af2f-d3f6d3f6a340),volume_type_id=2ef57f3e-e710-479f-af2f-d3f6d3f6a340)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1613952f-2309-4569-8a82-453f26306f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1613952f-2309-4569-8a82-453f26306f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7cf28e-1f02-4c69-a0dc-da1b55adbf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:48 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7cf28e-1f02-4c69-a0dc-da1b55adbf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a53b74b3-837e-4ed4-8589-32f4efa544ed', 'volume_name': 'volume-a53b74b3-837e-4ed4-8589-32f4efa544ed', 'volume_size': 1, 'image_id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce253df8-b25a-42ff-a251-86745c5c3b9b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1289558931', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '625aacf1fd9e4e1b8d7c089aaf585703', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'created_at': datetime.datetime(2026, 9, 11, 21, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce253df8-b25a-42ff-a251-86745c5c3b9b/file', 'properties': {}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:49 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d89883-dc4f-4f5a-83eb-2357d14364e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d89883-dc4f-4f5a-83eb-2357d14364e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a0b6ff-7bac-4fd8-9113-be2b87562251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:49 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume a53b74b3-837e-4ed4-8589-32f4efa544ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a53b74b3-837e-4ed4-8589-32f4efa544ed', 'volume_size': 1, 'image_id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce253df8-b25a-42ff-a251-86745c5c3b9b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1289558931', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '625aacf1fd9e4e1b8d7c089aaf585703', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'created_at': datetime.datetime(2026, 9, 11, 21, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce253df8-b25a-42ff-a251-86745c5c3b9b/file', 'properties': {}}, 'image_service': } Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Trying to clone a53b74b3-837e-4ed4-8589-32f4efa544ed from image ce253df8-b25a-42ff-a251-86745c5c3b9b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce253df8-b25a-42ff-a251-86745c5c3b9b', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 1073741824" returned: 0 in 0.974s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:49 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 Sep 11 23:12:49 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:49 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361" returned: 0 in 0.489s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfefd402-0581-4ffb-b640-b0170f0cf16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d689861c-13fe-4ce6-bb76-e9fa30299216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:49 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 (a7fa6e6d-0d89-4c51-9d3d-28e49bab9361): created successfully Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d689861c-13fe-4ce6-bb76-e9fa30299216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Flow 'volume_create_manager' (5341756b-c73a-47fe-846d-ab6d33a1d588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9762121f-3f50-4fda-974a-f718b1a9963d tempest-TestInstancesWithCinderVolumes-1823265745 None] Created volume successfully. Sep 11 23:12:54 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD, size 20.69 MB, duration 5.55 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:12:54 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Image download 20.69 MB at 3.73 MB/s Sep 11 23:12:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f3e70-83c4-49c6-947f-5f3a6706366c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:54 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD Sep 11 23:12:54 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:55 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Temporary image ce253df8-b25a-42ff-a251-86745c5c3b9b is fetched for user 3a7a9b0d32b3495aa0c753db49a3ae1a. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487d9b3-07cb-455b-a91e-dce44fe51dc2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:55 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD Sep 11 23:12:55 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:55 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1144844245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53b74b3-837e-4ed4-8589-32f4efa544ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625aacf1fd9e4e1b8d7c089aaf585703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:48Z,use_quota=True,user_id='3a7a9b0d32b3495aa0c753db49a3ae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ef57f3e-e710-479f-af2f-d3f6d3f6a340),volume_type_id=2ef57f3e-e710-479f-af2f-d3f6d3f6a340)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Creating volume a53b74b3-837e-4ed4-8589-32f4efa544ed {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:55 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:12:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:55 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed 1073741824 Sep 11 23:12:55 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:56 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (8ba4c081-be13-437c-9194-7f3da14233a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60d19e2-41ac-4635-bdd8-02bbe39b4992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed 1073741824" returned: 0 in 0.566s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60d19e2-41ac-4635-bdd8-02bbe39b4992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1126505063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0a991b-0758-43ea-a7f8-0fc4db2772dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:56Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb11f5e-8eb2-408c-861e-ee85a9f849a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb11f5e-8eb2-408c-861e-ee85a9f849a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858bdcfd-7107-43af-9093-1954acf38b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858bdcfd-7107-43af-9093-1954acf38b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0a991b-0758-43ea-a7f8-0fc4db2772dc', 'volume_name': 'volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66489ed6-a681-4ee7-9bce-4dd315e17f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66489ed6-a681-4ee7-9bce-4dd315e17f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9c6bf-e838-4f53-8216-47a70046fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Volume fc0a991b-0758-43ea-a7f8-0fc4db2772dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc', 'volume_size': 1} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:56 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed Sep 11 23:12:56 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:56 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1126505063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0a991b-0758-43ea-a7f8-0fc4db2772dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:56Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Creating volume fc0a991b-0758-43ea-a7f8-0fc4db2772dc {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:56 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:56 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc 1073741824 Sep 11 23:12:56 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Attempting download of ce253df8-b25a-42ff-a251-86745c5c3b9b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce253df8-b25a-42ff-a251-86745c5c3b9b', 'metadata': {}}])) to volume a53b74b3-837e-4ed4-8589-32f4efa544ed. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3840c8-997e-4130-9575-753fdd299f20]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:56 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v Sep 11 23:12:56 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:56 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v" returned: 0 in 0.361s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:56 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc 1073741824" returned: 0 in 0.498s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:57 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc Sep 11 23:12:57 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:57 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v Sep 11 23:12:57 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:57 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc" returned: 0 in 0.249s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9c6bf-e838-4f53-8216-47a70046fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3bdf94-fedd-41c0-aed2-270ae31bf4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:57 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v" returned: 1 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce253df8-b25a-42ff-a251-86745c5c3b9b_rczt170v' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088bd22-4807-4f5b-ad78-9b3831ecc941]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Volume volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc (fc0a991b-0758-43ea-a7f8-0fc4db2772dc): created successfully Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3bdf94-fedd-41c0-aed2-270ae31bf4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (8ba4c081-be13-437c-9194-7f3da14233a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-62f656cc-3dce-4d64-a61d-6794bc64c855 tempest-ProjectReaderTests-34618384 None] Created volume successfully. Sep 11 23:12:57 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD Sep 11 23:12:57 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:57 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] ce253df8-b25a-42ff-a251-86745c5c3b9b was qcow2, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:12:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:57 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed Sep 11 23:12:57 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-fc0a991b-0758-43ea-a7f8-0fc4db2772dc-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Lock "cinder-fc0a991b-0758-43ea-a7f8-0fc4db2772dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-quobyte-fc0a991b-0758-43ea-a7f8-0fc4db2772dc" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-fc0a991b-0758-43ea-a7f8-0fc4db2772dc" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[606591cc-42be-4c96-8848-ccd9b167b54a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:58 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc Sep 11 23:12:58 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:58 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc" returned: 0 in 0.534s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:59 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc Sep 11 23:12:59 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:59 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:59 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:59 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fc0a991b-0758-43ea-a7f8-0fc4db2772dc" returned: 0 in 0.354s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-fc0a991b-0758-43ea-a7f8-0fc4db2772dc" released by "delete_volume" :: held 0.934s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Created reservations ['050e9675-6734-4dad-b4aa-8acd37c042d0', 'bb60937c-3160-4035-b670-dc3bb6376759', '01b8bbb9-32aa-42ba-b721-9e8d8ad2aaea', '381da620-1b2a-4b70-b845-a2cabae1bc20'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:59 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:59 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:12:59 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:59 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.314s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Deleted volume successfully. Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d056347a-3bdc-4967-8639-41d866d90eb0 tempest-ProjectReaderTests-34618384 None] Lock "cinder-fc0a991b-0758-43ea-a7f8-0fc4db2772dc-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:59 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed" returned: 0 in 2.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce253df8-b25a-42ff-a251-86745c5c3b9b_g3lnfg_bdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:12:59 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Converted 112.00 MB image at 50.08 MB/s Sep 11 23:12:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:59 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed 1G Sep 11 23:12:59 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:00 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed 1G" returned: 0 in 0.320s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Downloaded image ce253df8-b25a-42ff-a251-86745c5c3b9b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce253df8-b25a-42ff-a251-86745c5c3b9b', 'metadata': {}}])) to volume a53b74b3-837e-4ed4-8589-32f4efa544ed successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Temporary image ce253df8-b25a-42ff-a251-86745c5c3b9b for user 3a7a9b0d32b3495aa0c753db49a3ae1a is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Marking volume a53b74b3-837e-4ed4-8589-32f4efa544ed as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Copying metadata from image ce253df8-b25a-42ff-a251-86745c5c3b9b to a53b74b3-837e-4ed4-8589-32f4efa544ed. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Creating volume glance metadata for volume a53b74b3-837e-4ed4-8589-32f4efa544ed backed by image ce253df8-b25a-42ff-a251-86745c5c3b9b with: {'image_id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'image_name': 'tempest-scenario-img--1289558931', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a0b6ff-7bac-4fd8-9113-be2b87562251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53b74b3-837e-4ed4-8589-32f4efa544ed', 'volume_size': 1, 'image_id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce253df8-b25a-42ff-a251-86745c5c3b9b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1289558931', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '625aacf1fd9e4e1b8d7c089aaf585703', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce253df8-b25a-42ff-a251-86745c5c3b9b', 'created_at': datetime.datetime(2026, 9, 11, 21, 12, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce253df8-b25a-42ff-a251-86745c5c3b9b/file', 'properties': {}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129cf87-5b11-4655-8d84-e2f513614065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Volume volume-a53b74b3-837e-4ed4-8589-32f4efa544ed (a53b74b3-837e-4ed4-8589-32f4efa544ed): created successfully Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129cf87-5b11-4655-8d84-e2f513614065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Flow 'volume_create_manager' (cef3a3af-fc7d-48e5-bb5e-c4643da82733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9c9abead-6736-4829-9868-e8166b0b3c6d tempest-TestInstancesWithCinderVolumes-1823265745 None] Created volume successfully. Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (78ad9476-1de1-43fc-8a01-6f5fe5d0aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef248ad-b518-45d8-b6df-464de7c6caa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef248ad-b518-45d8-b6df-464de7c6caa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092974839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1d0ad8-0908-47ac-914a-cb7b9efdd12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:01Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139afe8d-e0d4-4cc5-b3f9-2fed0e1f1516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139afe8d-e0d4-4cc5-b3f9-2fed0e1f1516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fb1801-00a8-4ccc-8169-1878489ad66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fb1801-00a8-4ccc-8169-1878489ad66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1d0ad8-0908-47ac-914a-cb7b9efdd12f', 'volume_name': 'volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8711d59-ac9d-4b2f-9a55-6a0fd4bea6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8711d59-ac9d-4b2f-9a55-6a0fd4bea6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d6e953-760b-413e-8d54-1b12aa2dad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Volume 3c1d0ad8-0908-47ac-914a-cb7b9efdd12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f', 'volume_size': 1} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092974839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1d0ad8-0908-47ac-914a-cb7b9efdd12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:01Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Creating volume 3c1d0ad8-0908-47ac-914a-cb7b9efdd12f {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:01 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:01 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f 1073741824 Sep 11 23:13:01 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:01 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f 1073741824" returned: 0 in 0.559s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:01 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f Sep 11 23:13:01 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:02 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f" returned: 0 in 0.317s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d6e953-760b-413e-8d54-1b12aa2dad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b31a82-19b9-4914-a0cd-9e351a54d8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Volume volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f (3c1d0ad8-0908-47ac-914a-cb7b9efdd12f): created successfully Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b31a82-19b9-4914-a0cd-9e351a54d8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (78ad9476-1de1-43fc-8a01-6f5fe5d0aa65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d64b069f-b49a-41d4-8f50-796397a76d65 tempest-ProjectReaderTests-34618384 None] Created volume successfully. Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Lock "cinder-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-quobyte-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffacf353-29f3-425d-bf86-62ead1150345]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:03 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f Sep 11 23:13:03 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:03 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f" returned: 0 in 0.482s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:03 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f Sep 11 23:13:03 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:04 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-9d2b549e-cc05-4a86-8279-2a2a87741629 req-01d3d9d6-3728-4684-85ec-9530aadc0658 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-9d2b549e-cc05-4a86-8279-2a2a87741629 req-01d3d9d6-3728-4684-85ec-9530aadc0658 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f" released by "delete_volume" :: held 0.869s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-9d2b549e-cc05-4a86-8279-2a2a87741629 req-01d3d9d6-3728-4684-85ec-9530aadc0658 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-9d2b549e-cc05-4a86-8279-2a2a87741629 req-01d3d9d6-3728-4684-85ec-9530aadc0658 tempest-TestInstancesWithCinderVolumes-1823265745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-a53b74b3-837e-4ed4-8589-32f4efa544ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e74e7eb-5aa5-4569-865d-286ba22bcd84', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Created reservations ['25e51814-56db-4e6f-9b89-5df624084e0e', '46ff19b9-0be6-42b5-88b0-fbdce1b014e7', '6d97d4f6-e1d5-48ea-9a5b-ad52e6ac9648', '9bbf5ff5-e099-4a35-9317-16a980b6346c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-9d2b549e-cc05-4a86-8279-2a2a87741629 req-01d3d9d6-3728-4684-85ec-9530aadc0658 tempest-TestInstancesWithCinderVolumes-1823265745 None] attachment_update completed successfully. Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:04 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:04 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:04 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:04 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Deleted volume successfully. Sep 11 23:13:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eb235ad6-3951-42b8-b52a-568a6c0ec1b9 tempest-ProjectReaderTests-34618384 None] Lock "cinder-3c1d0ad8-0908-47ac-914a-cb7b9efdd12f-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (595c0658-0563-4412-a814-a14d9c059f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661f1160-aaa3-44f9-b494-53d943bdbc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661f1160-aaa3-44f9-b494-53d943bdbc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889969700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e878b9-8b06-43eb-b21b-284a3c465201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:06Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39991a27-a91a-40bd-9429-270003e6ed70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39991a27-a91a-40bd-9429-270003e6ed70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e3d578-4c2e-49cf-8044-3e6577892f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e3d578-4c2e-49cf-8044-3e6577892f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e878b9-8b06-43eb-b21b-284a3c465201', 'volume_name': 'volume-f1e878b9-8b06-43eb-b21b-284a3c465201', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c1ca3e-ef98-46c4-a9a9-3cf996b7ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c1ca3e-ef98-46c4-a9a9-3cf996b7ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc37920-c67b-4ad7-b5a6-eeebf7675792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Volume f1e878b9-8b06-43eb-b21b-284a3c465201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e878b9-8b06-43eb-b21b-284a3c465201', 'volume_size': 1} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889969700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e878b9-8b06-43eb-b21b-284a3c465201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:06Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Creating volume f1e878b9-8b06-43eb-b21b-284a3c465201 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:06 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:13:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:06 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 1073741824 Sep 11 23:13:06 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:07 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 1073741824" returned: 0 in 0.678s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:07 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 Sep 11 23:13:07 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:07 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201" returned: 0 in 0.325s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc37920-c67b-4ad7-b5a6-eeebf7675792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e878b9-8b06-43eb-b21b-284a3c465201', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18519642-faa5-40e7-b191-11cf5ac0973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:07 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Volume volume-f1e878b9-8b06-43eb-b21b-284a3c465201 (f1e878b9-8b06-43eb-b21b-284a3c465201): created successfully Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18519642-faa5-40e7-b191-11cf5ac0973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (595c0658-0563-4412-a814-a14d9c059f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8af8fc84-2693-4f3b-99f0-7477725f0262 tempest-ProjectReaderTests-34618384 None] Created volume successfully. Sep 11 23:13:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-f1e878b9-8b06-43eb-b21b-284a3c465201-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Lock "cinder-f1e878b9-8b06-43eb-b21b-284a3c465201-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-quobyte-f1e878b9-8b06-43eb-b21b-284a3c465201" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-f1e878b9-8b06-43eb-b21b-284a3c465201" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab1c3a-3278-4422-9326-ec2699d1eab9]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:09 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 Sep 11 23:13:09 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:09 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201" returned: 0 in 0.569s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:09 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201 Sep 11 23:13:09 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:09 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f1e878b9-8b06-43eb-b21b-284a3c465201" returned: 0 in 0.323s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-f1e878b9-8b06-43eb-b21b-284a3c465201" released by "delete_volume" :: held 0.982s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:09 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Created reservations ['5e66052a-2439-4adb-9e74-46aa2140077f', 'c6b98b28-d431-4d33-be0d-889e92698152', '009dabc0-9d16-4615-b76a-7cb730cec37e', 'd81968ae-64ff-4eda-a581-091ef5a54917'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:10 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:10 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:10 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Deleted volume successfully. Sep 11 23:13:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1bba46ec-f7c7-41f7-802f-84f7248c2d7c tempest-ProjectReaderTests-34618384 None] Lock "cinder-f1e878b9-8b06-43eb-b21b-284a3c465201-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (2c239058-eccd-40cb-8f5e-058e8e91973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698421e6-2ea3-4efb-8a3a-bf8022044809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698421e6-2ea3-4efb-8a3a-bf8022044809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256056938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf73273-0e23-4917-9f75-0c6e6543a875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:12Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197e56b8-51e2-498f-a117-937fd6da38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197e56b8-51e2-498f-a117-937fd6da38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ae175b-3852-4d72-9777-e500c43c77a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ae175b-3852-4d72-9777-e500c43c77a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf73273-0e23-4917-9f75-0c6e6543a875', 'volume_name': 'volume-cdf73273-0e23-4917-9f75-0c6e6543a875', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186d7e52-3ba3-459a-8047-9d5d3709e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186d7e52-3ba3-459a-8047-9d5d3709e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19d1485-48a9-4327-b230-0abb4d02312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Volume cdf73273-0e23-4917-9f75-0c6e6543a875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf73273-0e23-4917-9f75-0c6e6543a875', 'volume_size': 1} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256056938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf73273-0e23-4917-9f75-0c6e6543a875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94299d2119ce4569894dfb601a46eae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:12Z,use_quota=True,user_id='25b794a9cc8a4332ae5d2297df100f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Creating volume cdf73273-0e23-4917-9f75-0c6e6543a875 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:12 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:12 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 1073741824 Sep 11 23:13:12 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4205590f-a3f2-416e-9d4b-c5892c457943 req-3d334b20-de28-4a4b-9f66-0643c4c41287 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:13 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 1073741824" returned: 0 in 0.820s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:13 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 Sep 11 23:13:13 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:13 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4205590f-a3f2-416e-9d4b-c5892c457943 req-3d334b20-de28-4a4b-9f66-0643c4c41287 tempest-TestStampPattern-1193458763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.982s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19d1485-48a9-4327-b230-0abb4d02312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf73273-0e23-4917-9f75-0c6e6543a875', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa303d8a-8d29-40cd-b112-0ac4676b8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4205590f-a3f2-416e-9d4b-c5892c457943 req-3d334b20-de28-4a4b-9f66-0643c4c41287 tempest-TestStampPattern-1193458763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Volume volume-cdf73273-0e23-4917-9f75-0c6e6543a875 (cdf73273-0e23-4917-9f75-0c6e6543a875): created successfully Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa303d8a-8d29-40cd-b112-0ac4676b8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Flow 'volume_create_manager' (2c239058-eccd-40cb-8f5e-058e8e91973f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f8072142-924e-49b5-ad91-8b3c65af1729 tempest-ProjectReaderTests-34618384 None] Created volume successfully. Sep 11 23:13:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-4205590f-a3f2-416e-9d4b-c5892c457943 req-3d334b20-de28-4a4b-9f66-0643c4c41287 tempest-TestStampPattern-1193458763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82965fea-6d89-4bae-99ee-5cccc4376455', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:13:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-4205590f-a3f2-416e-9d4b-c5892c457943 req-3d334b20-de28-4a4b-9f66-0643c4c41287 tempest-TestStampPattern-1193458763 None] attachment_update completed successfully. Sep 11 23:13:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-cdf73273-0e23-4917-9f75-0c6e6543a875-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Lock "cinder-cdf73273-0e23-4917-9f75-0c6e6543a875-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Acquiring lock "cinder-quobyte-cdf73273-0e23-4917-9f75-0c6e6543a875" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-cdf73273-0e23-4917-9f75-0c6e6543a875" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d118b90-f1e0-4c57-b5b5-f4bd9d7c9311]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:14 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 Sep 11 23:13:14 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:15 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875" returned: 0 in 0.648s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:15 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875 Sep 11 23:13:15 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:15 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cdf73273-0e23-4917-9f75-0c6e6543a875" returned: 0 in 0.338s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Lock "cinder-quobyte-cdf73273-0e23-4917-9f75-0c6e6543a875" released by "delete_volume" :: held 1.111s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Created reservations ['c33e2630-3d7b-4147-b0be-636fb3923731', '4c447550-7c0e-46c1-96e7-b92911f588ca', 'b199ed3b-7f76-48b0-b7c8-aae8a8083d47', '2ea1d4c2-43e9-4d07-9177-d17cfed4ee94'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:15 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:15 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:16 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.485s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:16 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:16 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Deleted volume successfully. Sep 11 23:13:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1912cf1e-3a64-4844-a1da-dffd718fe1bd tempest-ProjectReaderTests-34618384 None] Lock "cinder-cdf73273-0e23-4917-9f75-0c6e6543a875-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-095009a3-55e8-4fe3-b3c7-00e2d476176b req-34fa7c1c-f994-40af-a4de-236bc5108d96 tempest-TestStampPattern-1193458763 None] Terminate volume connection completed successfully. Sep 11 23:13:18 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-095009a3-55e8-4fe3-b3c7-00e2d476176b req-34fa7c1c-f994-40af-a4de-236bc5108d96 tempest-TestStampPattern-1193458763 None] Deleting attachment 82965fea-6d89-4bae-99ee-5cccc4376455. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-c9bf9482-d1df-4a90-8e07-cbc7de809a07-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Lock "cinder-c9bf9482-d1df-4a90-8e07-cbc7de809a07-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-quobyte-c9bf9482-d1df-4a90-8e07-cbc7de809a07" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-c9bf9482-d1df-4a90-8e07-cbc7de809a07" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[609764b1-9c84-42f7-8c56-665dd1151866]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:27 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 Sep 11 23:13:27 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:27 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07" returned: 0 in 0.417s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:27 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07 Sep 11 23:13:27 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:28 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c9bf9482-d1df-4a90-8e07-cbc7de809a07" returned: 0 in 0.299s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-c9bf9482-d1df-4a90-8e07-cbc7de809a07" released by "delete_volume" :: held 0.780s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Created reservations ['abcb4a6e-a5d3-4e65-ac6a-9a2b2de05f6e', '0898ca21-c8ed-4996-86fb-a260aa00cf48', 'cac79427-c665-4020-9dc1-3289c457ae22', '2236d816-6e12-4157-add6-2aa1740f9452'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:28 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:28 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:28 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.336s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Deleted volume successfully. Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-59b735a2-9a71-4425-a209-01e867daf662 tempest-TestStampPattern-1193458763 None] Lock "cinder-c9bf9482-d1df-4a90-8e07-cbc7de809a07-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-a382cdd0-8fa7-44e2-97a4-b81563310127-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Lock "cinder-a382cdd0-8fa7-44e2-97a4-b81563310127-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-quobyte-96ca137a-f6d7-4f70-b16b-d60428847685" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-96ca137a-f6d7-4f70-b16b-d60428847685" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-quobyte-a382cdd0-8fa7-44e2-97a4-b81563310127" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-a382cdd0-8fa7-44e2-97a4-b81563310127" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Deleting offline snapshot a382cdd0-8fa7-44e2-97a4-b81563310127 of volume 96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] snapshot_file for this snap is: volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1610559-3931-4c5c-8cfc-442a903d0c05]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:29 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 Sep 11 23:13:29 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:29 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96ca137a-f6d7-4f70-b16b-d60428847685(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:13:29 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c98140e-58af-4534-96d8-44fbcf869ac7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:29 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 Sep 11 23:13:29 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:29 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685" returned: 0 in 0.497s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:29 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 Sep 11 23:13:29 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:30 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:30 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127 Sep 11 23:13:30 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:30 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685.a382cdd0-8fa7-44e2-97a4-b81563310127" returned: 0 in 0.256s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-a382cdd0-8fa7-44e2-97a4-b81563310127" released by "_delete_snapshot" :: held 1.559s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-96ca137a-f6d7-4f70-b16b-d60428847685" released by "delete_snapshot" :: held 1.585s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Created reservations ['0ef33bac-bf5c-44a1-b515-9a8cd12fbcc8', 'fe248f5c-f6cf-4c8a-b85d-bfcedcce2294', 'ad2b1662-cf9f-4c11-b3ae-6eed5d127262', '81404a93-ecde-4a72-8a6c-88d1da9f7200'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Delete snapshot completed successfully. Sep 11 23:13:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1081389e-0663-486b-ba12-586a734a10fb tempest-TestStampPattern-1193458763 None] Lock "cinder-a382cdd0-8fa7-44e2-97a4-b81563310127-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-96ca137a-f6d7-4f70-b16b-d60428847685-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Lock "cinder-96ca137a-f6d7-4f70-b16b-d60428847685-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Acquiring lock "cinder-quobyte-96ca137a-f6d7-4f70-b16b-d60428847685" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-96ca137a-f6d7-4f70-b16b-d60428847685" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:34 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3bc8a1-ffff-4e64-9e8b-9d947a8f407d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:34 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 Sep 11 23:13:34 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:35 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685" returned: 0 in 0.367s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:35 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685 Sep 11 23:13:35 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:35 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-96ca137a-f6d7-4f70-b16b-d60428847685" returned: 0 in 0.259s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Lock "cinder-quobyte-96ca137a-f6d7-4f70-b16b-d60428847685" released by "delete_volume" :: held 0.688s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Created reservations ['742177b8-bdad-4a40-a19b-e48aa2f4f70b', '7c36258e-942b-4c3f-b208-334608569586', '18660e50-607a-429b-84ba-21bb98a9f275', 'd652e308-745c-4a6d-ad31-d71866466956'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:35 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:35 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:35 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.272s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Deleted volume successfully. Sep 11 23:13:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8bf71e9-15ec-4cc1-9be8-5aa4afe1df56 tempest-TestStampPattern-1193458763 None] Lock "cinder-96ca137a-f6d7-4f70-b16b-d60428847685-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4112c028-3be6-4892-8de2-ee513478c72e req-ab576e31-754e-4dc2-8348-2045e7cd00df tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4112c028-3be6-4892-8de2-ee513478c72e req-ab576e31-754e-4dc2-8348-2045e7cd00df tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-4112c028-3be6-4892-8de2-ee513478c72e req-ab576e31-754e-4dc2-8348-2045e7cd00df tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-4112c028-3be6-4892-8de2-ee513478c72e req-ab576e31-754e-4dc2-8348-2045e7cd00df tempest-TestInstancesWithCinderVolumes-1823265745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-4027be5b-0cdb-4285-aa02-c7659b93e996', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5522f0ca-49bf-4e4d-afae-b10f22b17f3e', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:13:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-4112c028-3be6-4892-8de2-ee513478c72e req-ab576e31-754e-4dc2-8348-2045e7cd00df tempest-TestInstancesWithCinderVolumes-1823265745 None] attachment_update completed successfully. Sep 11 23:13:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-ba625af5-fa37-42e2-963d-abca56415cb7 req-ab787339-995f-44f2-802a-6d2eac571fa9 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-ba625af5-fa37-42e2-963d-abca56415cb7 req-ab787339-995f-44f2-802a-6d2eac571fa9 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-ba625af5-fa37-42e2-963d-abca56415cb7 req-ab787339-995f-44f2-802a-6d2eac571fa9 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-ba625af5-fa37-42e2-963d-abca56415cb7 req-ab787339-995f-44f2-802a-6d2eac571fa9 tempest-TestInstancesWithCinderVolumes-1823265745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82aff609-3073-4927-848a-f2e1888a71c8', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:13:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-ba625af5-fa37-42e2-963d-abca56415cb7 req-ab787339-995f-44f2-802a-6d2eac571fa9 tempest-TestInstancesWithCinderVolumes-1823265745 None] attachment_update completed successfully. Sep 11 23:13:46 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=83,cinder:UPDATE=82,cinder:INSERT=20,cinder:DELETE=5 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:13:46 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=83,cinder:SELECT=82,cinder:INSERT=24,cinder:DELETE=8 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:13:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Flow 'volume_create_manager' (100694a6-7fd5-4d30-9454-8a25cb86c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b093b651-7d5e-4b63-8808-369aa47ba6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b093b651-7d5e-4b63-8808-369aa47ba6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-972124191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53824f06-d63d-4e87-ad26-56c04c577d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7dc4fac4614a5bb1d20485b9ae23cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:47Z,use_quota=True,user_id='325f9713aba241bd872133fcfe57e51c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8aec1cb-ef41-4a2e-8046-40a4b623731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8aec1cb-ef41-4a2e-8046-40a4b623731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005cc1d1-37dc-49f0-8153-16ff50955483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005cc1d1-37dc-49f0-8153-16ff50955483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53824f06-d63d-4e87-ad26-56c04c577d33', 'volume_name': 'volume-53824f06-d63d-4e87-ad26-56c04c577d33', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adf60f4-e631-41da-b3a1-9d88b297f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adf60f4-e631-41da-b3a1-9d88b297f074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2b342c-6f8c-4351-a690-90667c629fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Volume 53824f06-d63d-4e87-ad26-56c04c577d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53824f06-d63d-4e87-ad26-56c04c577d33', 'volume_size': 1} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-972124191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53824f06-d63d-4e87-ad26-56c04c577d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7dc4fac4614a5bb1d20485b9ae23cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:47Z,use_quota=True,user_id='325f9713aba241bd872133fcfe57e51c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Creating volume 53824f06-d63d-4e87-ad26-56c04c577d33 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:47 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:47 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 1073741824 Sep 11 23:13:47 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-bd0bc7a4-6c8a-48ed-8ef3-4a9f4620d823 req-8a6ffb63-66c7-4983-966f-cc68e129688b tempest-TestInstancesWithCinderVolumes-1823265745 None] Terminate volume connection completed successfully. Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-bd0bc7a4-6c8a-48ed-8ef3-4a9f4620d823 req-8a6ffb63-66c7-4983-966f-cc68e129688b tempest-TestInstancesWithCinderVolumes-1823265745 None] Deleting attachment 5522f0ca-49bf-4e4d-afae-b10f22b17f3e. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:13:47 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 1073741824" returned: 0 in 0.493s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:47 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 Sep 11 23:13:47 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:47 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33" returned: 0 in 0.283s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2b342c-6f8c-4351-a690-90667c629fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53824f06-d63d-4e87-ad26-56c04c577d33', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad599e6a-7abf-400e-a9c3-e993b2dac3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "cinder-4027be5b-0cdb-4285-aa02-c7659b93e996-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Volume volume-53824f06-d63d-4e87-ad26-56c04c577d33 (53824f06-d63d-4e87-ad26-56c04c577d33): created successfully Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad599e6a-7abf-400e-a9c3-e993b2dac3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Flow 'volume_create_manager' (100694a6-7fd5-4d30-9454-8a25cb86c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-4027be5b-0cdb-4285-aa02-c7659b93e996-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fcd056f8-979c-4c9f-a6ae-2bb514e49a96 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Created volume successfully. Sep 11 23:13:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "cinder-quobyte-4027be5b-0cdb-4285-aa02-c7659b93e996" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-quobyte-4027be5b-0cdb-4285-aa02-c7659b93e996" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabfcac7-d4f5-4bb1-9882-20ee3e3e932c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:48 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 Sep 11 23:13:48 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:48 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996" returned: 0 in 0.403s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:48 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996 Sep 11 23:13:48 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:48 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4027be5b-0cdb-4285-aa02-c7659b93e996" returned: 0 in 0.307s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-quobyte-4027be5b-0cdb-4285-aa02-c7659b93e996" released by "delete_volume" :: held 0.750s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:48 devstack cinder-volume[88002]: WARNING cinder.quota [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399240488-384732649 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399240488-384732649, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:13:48 devstack cinder-volume[88002]: WARNING cinder.quota [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399240488-384732649 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399240488-384732649, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Created reservations ['878ab585-82f0-4a90-8bb4-64a8ec06cc38', 'c0df9eeb-994e-4583-b49d-e048e55deec7', '9deb11d5-cc90-4961-90a6-e3a642fdcd41', 'cb88a031-0058-4eaa-992a-60c3798b3cf7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:48 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:48 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:49 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deleted volume successfully. Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b739e6e-774b-4f61-a3a1-6e7ec015b225 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-4027be5b-0cdb-4285-aa02-c7659b93e996-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-45732867-ed2a-44b8-8f50-34bc26257766 req-a1763e33-a2ef-493d-9b31-08918b662229 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-45732867-ed2a-44b8-8f50-34bc26257766 req-a1763e33-a2ef-493d-9b31-08918b662229 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-45732867-ed2a-44b8-8f50-34bc26257766 req-a1763e33-a2ef-493d-9b31-08918b662229 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-45732867-ed2a-44b8-8f50-34bc26257766 req-a1763e33-a2ef-493d-9b31-08918b662229 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-53824f06-d63d-4e87-ad26-56c04c577d33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff350ac9-a071-41be-b25d-2d3a8b9f972d', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:13:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-45732867-ed2a-44b8-8f50-34bc26257766 req-a1763e33-a2ef-493d-9b31-08918b662229 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] attachment_update completed successfully. Sep 11 23:13:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-c2d48ed5-0417-461c-aa56-bd57425dd34d req-b9bd22ca-1ed3-4d01-8591-8ab45238193d tempest-TestInstancesWithCinderVolumes-1823265745 None] Terminate volume connection completed successfully. Sep 11 23:13:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-c2d48ed5-0417-461c-aa56-bd57425dd34d req-b9bd22ca-1ed3-4d01-8591-8ab45238193d tempest-TestInstancesWithCinderVolumes-1823265745 None] Deleting attachment 82aff609-3073-4927-848a-f2e1888a71c8. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:13:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-27e500c3-e5ed-475a-8315-f1f610330380 req-88af1e45-728a-4d11-b7ea-57a6b98ea46e tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Terminate volume connection completed successfully. Sep 11 23:13:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-27e500c3-e5ed-475a-8315-f1f610330380 req-88af1e45-728a-4d11-b7ea-57a6b98ea46e tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Deleting attachment ff350ac9-a071-41be-b25d-2d3a8b9f972d. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:13:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "cinder-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "cinder-quobyte-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-quobyte-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[454ce42b-85cb-46f8-93cd-38d60644f63d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:53 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 Sep 11 23:13:53 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Acquiring lock "cinder-53824f06-d63d-4e87-ad26-56c04c577d33-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "cinder-53824f06-d63d-4e87-ad26-56c04c577d33-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Acquiring lock "cinder-quobyte-53824f06-d63d-4e87-ad26-56c04c577d33" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "cinder-quobyte-53824f06-d63d-4e87-ad26-56c04c577d33" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[681994a3-e9f0-45ce-89f7-31833e30d813]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:53 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361" returned: 0 in 0.495s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:53 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361 Sep 11 23:13:53 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:53 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 Sep 11 23:13:53 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:53 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361" returned: 0 in 0.354s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-quobyte-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361" released by "delete_volume" :: held 0.905s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:53 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33" returned: 0 in 0.445s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:53 devstack cinder-volume[88002]: WARNING cinder.quota [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-945791832-1808861309 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-945791832-1808861309, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:13:53 devstack cinder-volume[88002]: WARNING cinder.quota [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-945791832-1808861309 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-945791832-1808861309, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:13:53 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33 Sep 11 23:13:53 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:53 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Created reservations ['85424a0e-d5b7-493d-9b67-3312ba63edb4', '149cd6d6-8e99-4850-a470-a87d59115fb0', '04b655fa-6f1c-47c0-836a-0bf8e33c623c', '43366237-a0e0-4d6d-a8d5-3bef8d999063'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:54 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:54 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:54 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-53824f06-d63d-4e87-ad26-56c04c577d33" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "cinder-quobyte-53824f06-d63d-4e87-ad26-56c04c577d33" released by "delete_volume" :: held 0.844s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Created reservations ['501eb960-c120-4f29-b185-0e65f54d44fd', '41803251-39be-422c-86b3-c0acc328465a', 'cf55c0cf-4c79-4b39-a29b-b39b92c11e34', 'c1913e0f-65ef-4a7b-8c8f-07edd72a7131'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:54 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:54 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:54 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Flow 'volume_create_manager' (ac06d8da-c23f-41f7-b185-6206972e740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3fc440-c871-4f6d-b6b7-b7f9e5429d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.564s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3fc440-c871-4f6d-b6b7-b7f9e5429d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00c815a-12e0-4bd5-a453-2d86ac177c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f6e27b34ad4592991332008257c06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:54Z,use_quota=True,user_id='3eebd14b96284d9aa2121d2d0ebbfbd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(018aecfe-15ef-4512-8f8b-2a1aa8702655),volume_type_id=018aecfe-15ef-4512-8f8b-2a1aa8702655)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d8ab99-3b70-45ae-a5f3-2cfa9b81b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d8ab99-3b70-45ae-a5f3-2cfa9b81b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8797c866-de5b-4645-95ed-9b6a79b5c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:13:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deleted volume successfully. Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1e3892d8-ec6e-42af-a627-b5f0ba60bc48 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-a7fa6e6d-0d89-4c51-9d3d-28e49bab9361-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:54 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.388s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Deleted volume successfully. Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c7ee87c0-8129-4834-b2e6-183a00531f10 tempest-TestServerVolumeAttachScenarioOldVersion-972901315 None] Lock "cinder-53824f06-d63d-4e87-ad26-56c04c577d33-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8797c866-de5b-4645-95ed-9b6a79b5c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b00c815a-12e0-4bd5-a453-2d86ac177c96', 'volume_name': 'volume-b00c815a-12e0-4bd5-a453-2d86ac177c96', 'volume_size': 1, 'image_id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da4b26bc-6239-47e1-8825-9f53ca0d4000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47aa060f52884b4a6d8794146c6685a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1f6e27b34ad4592991332008257c06d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c0f0ed8848b26b23336f00c500bb81d2b6e35e6cf03e6196955cc532bc548bc8732119540ce55e88da6ee5125a990aaf80e42ad19753f0fb501636e024f6a1b', 'id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'created_at': datetime.datetime(2026, 9, 11, 21, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da4b26bc-6239-47e1-8825-9f53ca0d4000/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4e03ff-456e-4339-8023-9cb7c4a1fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4e03ff-456e-4339-8023-9cb7c4a1fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce93870f-5c1a-4678-b070-a56a1e052e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Volume b00c815a-12e0-4bd5-a453-2d86ac177c96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b00c815a-12e0-4bd5-a453-2d86ac177c96', 'volume_size': 1, 'image_id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da4b26bc-6239-47e1-8825-9f53ca0d4000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47aa060f52884b4a6d8794146c6685a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1f6e27b34ad4592991332008257c06d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c0f0ed8848b26b23336f00c500bb81d2b6e35e6cf03e6196955cc532bc548bc8732119540ce55e88da6ee5125a990aaf80e42ad19753f0fb501636e024f6a1b', 'id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'created_at': datetime.datetime(2026, 9, 11, 21, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da4b26bc-6239-47e1-8825-9f53ca0d4000/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Trying to clone b00c815a-12e0-4bd5-a453-2d86ac177c96 from image da4b26bc-6239-47e1-8825-9f53ca0d4000 at location (None, [{'url': 'file:///opt/stack/data/glance/images/da4b26bc-6239-47e1-8825-9f53ca0d4000', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:13:55 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f44fc0-7ffa-4335-9a23-5be9e9d7863a]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:55 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD Sep 11 23:13:55 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:56 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:56 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD Sep 11 23:13:56 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:56 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD" returned: 1 in 0.469s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Temporary image da4b26bc-6239-47e1-8825-9f53ca0d4000 is fetched for user 3eebd14b96284d9aa2121d2d0ebbfbd8. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839e7a7-d292-4990-bd38-9aecdb2e53d6]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:56 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD Sep 11 23:13:56 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:57 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:57 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD Sep 11 23:13:57 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:57 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00c815a-12e0-4bd5-a453-2d86ac177c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f6e27b34ad4592991332008257c06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:54Z,use_quota=True,user_id='3eebd14b96284d9aa2121d2d0ebbfbd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(018aecfe-15ef-4512-8f8b-2a1aa8702655),volume_type_id=018aecfe-15ef-4512-8f8b-2a1aa8702655)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Creating volume b00c815a-12e0-4bd5-a453-2d86ac177c96 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:57 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:13:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:57 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 1073741824 Sep 11 23:13:57 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:58 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 1073741824" returned: 0 in 0.567s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:58 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 Sep 11 23:13:58 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:58 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96" returned: 0 in 0.378s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Attempting download of da4b26bc-6239-47e1-8825-9f53ca0d4000 ((None, [{'url': 'file:///opt/stack/data/glance/images/da4b26bc-6239-47e1-8825-9f53ca0d4000', 'metadata': {}}])) to volume b00c815a-12e0-4bd5-a453-2d86ac177c96. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:13:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-db3ca18d-99ee-4d3a-aff3-9f589680d438 req-ec3c99c1-e78b-4bfd-9774-38071abb0d8b tempest-TestInstancesWithCinderVolumes-1823265745 None] Terminate volume connection completed successfully. Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-db3ca18d-99ee-4d3a-aff3-9f589680d438 req-ec3c99c1-e78b-4bfd-9774-38071abb0d8b tempest-TestInstancesWithCinderVolumes-1823265745 None] Deleting attachment 8e74e7eb-5aa5-4569-865d-286ba22bcd84. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3188f-0bcd-4689-bde2-b5d623073a40]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:58 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar Sep 11 23:13:58 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:59 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:13:59 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:59 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar" returned: 0 in 0.384s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:59 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar Sep 11 23:13:59 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:59 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:13:59 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar" returned: 1 in 0.387s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da4b26bc-6239-47e1-8825-9f53ca0d4000_hdwr5zar' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d031e9-962b-4e7c-a058-b1b6c7cf7a23]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:59 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD Sep 11 23:13:59 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "cinder-a53b74b3-837e-4ed4-8589-32f4efa544ed-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-a53b74b3-837e-4ed4-8589-32f4efa544ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "cinder-quobyte-a53b74b3-837e-4ed4-8589-32f4efa544ed" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-quobyte-a53b74b3-837e-4ed4-8589-32f4efa544ed" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be4628f-d5a2-4fd8-ad4d-9f2d79b97fde]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed Sep 11 23:14:00 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD Sep 11 23:14:00 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed Sep 11 23:14:00 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] da4b26bc-6239-47e1-8825-9f53ca0d4000 was raw, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 Sep 11 23:14:00 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a53b74b3-837e-4ed4-8589-32f4efa544ed" returned: 0 in 0.325s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-quobyte-a53b74b3-837e-4ed4-8589-32f4efa544ed" released by "delete_volume" :: held 0.755s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:00 devstack cinder-volume[88002]: WARNING cinder.quota [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1476889875-1782228076 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1476889875-1782228076, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:14:00 devstack cinder-volume[88002]: WARNING cinder.quota [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1476889875-1782228076 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1476889875-1782228076, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Created reservations ['2d9c50a1-3976-45d7-add9-c5a7f1118e8f', '76b521a9-f030-4ce6-840c-4aaa132a5d2f', '4a72481c-7dd3-46af-80b1-b310fe78085a', '47c4ba71-988f-4b04-a615-641b36701753'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:00 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96" returned: 0 in 0.547s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da4b26bc-6239-47e1-8825-9f53ca0d4000_781c0g3sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:14:00 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:14:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 1G Sep 11 23:14:00 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:01 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Deleted volume successfully. Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d14233f4-faae-4cc7-8bfc-f4f3e8a7a433 tempest-TestInstancesWithCinderVolumes-1823265745 None] Lock "cinder-a53b74b3-837e-4ed4-8589-32f4efa544ed-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:01 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 1G" returned: 0 in 0.376s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Downloaded image da4b26bc-6239-47e1-8825-9f53ca0d4000 ((None, [{'url': 'file:///opt/stack/data/glance/images/da4b26bc-6239-47e1-8825-9f53ca0d4000', 'metadata': {}}])) to volume b00c815a-12e0-4bd5-a453-2d86ac177c96 successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Temporary image da4b26bc-6239-47e1-8825-9f53ca0d4000 for user 3eebd14b96284d9aa2121d2d0ebbfbd8 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Marking volume b00c815a-12e0-4bd5-a453-2d86ac177c96 as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Copying metadata from image da4b26bc-6239-47e1-8825-9f53ca0d4000 to b00c815a-12e0-4bd5-a453-2d86ac177c96. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Creating volume glance metadata for volume b00c815a-12e0-4bd5-a453-2d86ac177c96 backed by image da4b26bc-6239-47e1-8825-9f53ca0d4000 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '47aa060f52884b4a6d8794146c6685a2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce93870f-5c1a-4678-b070-a56a1e052e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00c815a-12e0-4bd5-a453-2d86ac177c96', 'volume_size': 1, 'image_id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da4b26bc-6239-47e1-8825-9f53ca0d4000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47aa060f52884b4a6d8794146c6685a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1f6e27b34ad4592991332008257c06d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c0f0ed8848b26b23336f00c500bb81d2b6e35e6cf03e6196955cc532bc548bc8732119540ce55e88da6ee5125a990aaf80e42ad19753f0fb501636e024f6a1b', 'id': 'da4b26bc-6239-47e1-8825-9f53ca0d4000', 'created_at': datetime.datetime(2026, 9, 11, 21, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da4b26bc-6239-47e1-8825-9f53ca0d4000/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8424e8-ff29-43f4-a538-973a10b0885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Volume volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 (b00c815a-12e0-4bd5-a453-2d86ac177c96): created successfully Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8424e8-ff29-43f4-a538-973a10b0885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Flow 'volume_create_manager' (ac06d8da-c23f-41f7-b185-6206972e740b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-96fe5e42-ca6a-4edd-9548-f39821c20aaf tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Created volume successfully. Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Acquiring lock "cinder-b00c815a-12e0-4bd5-a453-2d86ac177c96-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "cinder-b00c815a-12e0-4bd5-a453-2d86ac177c96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Acquiring lock "cinder-quobyte-b00c815a-12e0-4bd5-a453-2d86ac177c96" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "cinder-quobyte-b00c815a-12e0-4bd5-a453-2d86ac177c96" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fcd995-c2bc-4228-be7e-4062577a320e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:02 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 Sep 11 23:14:02 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:02 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:02 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96 Sep 11 23:14:02 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:03 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b00c815a-12e0-4bd5-a453-2d86ac177c96" returned: 0 in 0.258s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "cinder-quobyte-b00c815a-12e0-4bd5-a453-2d86ac177c96" released by "delete_volume" :: held 0.768s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:03 devstack cinder-volume[88002]: WARNING cinder.quota [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:14:03 devstack cinder-volume[88002]: WARNING cinder.quota [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Created reservations ['42926b92-03a7-46fd-bdfd-b645d612b4ab', '350bfdec-e452-4ef9-a122-bc059cc0b417', '085c1cbb-c368-4109-8cbc-56a1ca298bdb', 'bf68dc61-e4e1-49ae-bf2d-7106715086e8'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:03 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:03 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:03 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.308s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Deleted volume successfully. Sep 11 23:14:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ebcc358b-c50d-4a37-a39f-3502708fe2a6 tempest-VolumeAndVolumeTypeFromImageTest-1979716135 None] Lock "cinder-b00c815a-12e0-4bd5-a453-2d86ac177c96-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (cafe73ed-e285-437d-8b55-786d5970558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64f73c1-1762-485d-8905-91c874099bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64f73c1-1762-485d-8905-91c874099bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262550194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12800601-56a0-4451-b4d6-d8f18bdff753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:10Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a67b7d5-0b37-42f8-aad2-98bf36f6cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a67b7d5-0b37-42f8-aad2-98bf36f6cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5599c4-c978-456d-b28f-f9ea1c862a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5599c4-c978-456d-b28f-f9ea1c862a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12800601-56a0-4451-b4d6-d8f18bdff753', 'volume_name': 'volume-12800601-56a0-4451-b4d6-d8f18bdff753', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e2063a-52d3-41a4-9fa9-c64efdf14dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e2063a-52d3-41a4-9fa9-c64efdf14dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cba262-9006-4fc3-b14b-aec82f13d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:09 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Volume 12800601-56a0-4451-b4d6-d8f18bdff753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12800601-56a0-4451-b4d6-d8f18bdff753', 'volume_size': 1} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262550194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12800601-56a0-4451-b4d6-d8f18bdff753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:10Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Creating volume 12800601-56a0-4451-b4d6-d8f18bdff753 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:09 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:09 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 1073741824 Sep 11 23:14:09 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (9937d0c9-fa30-4bd1-8312-21d8ad72be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73028748-2214-4ea3-a72c-0ff4e59baeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73028748-2214-4ea3-a72c-0ff4e59baeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1459435691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68080be9-2cba-4da1-8fcd-a9749a614155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:10Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c774256-b67c-4a42-baf5-afe3d4fe0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c774256-b67c-4a42-baf5-afe3d4fe0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54326d4-22d3-4f5c-bbf6-4f052a7f2565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54326d4-22d3-4f5c-bbf6-4f052a7f2565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68080be9-2cba-4da1-8fcd-a9749a614155', 'volume_name': 'volume-68080be9-2cba-4da1-8fcd-a9749a614155', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e849e76-3297-465d-a2a9-77d9d83de72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e849e76-3297-465d-a2a9-77d9d83de72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef20f5c-b38b-4f8a-8d91-c6965913b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Volume 68080be9-2cba-4da1-8fcd-a9749a614155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68080be9-2cba-4da1-8fcd-a9749a614155', 'volume_size': 1} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:10 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 1073741824" returned: 0 in 0.908s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (02076845-c3ca-4247-bf05-adf91aa5baec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682a2cde-7b4e-4112-af75-6e2ad7fded41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682a2cde-7b4e-4112-af75-6e2ad7fded41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778209962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c89faf8-4917-49ff-8ec6-5a34b5ac9971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:11Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c71dc84-02a9-42c2-89b5-11868226fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c71dc84-02a9-42c2-89b5-11868226fc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5907bf10-90a5-4405-a0f2-11f0cfd6f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5907bf10-90a5-4405-a0f2-11f0cfd6f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c89faf8-4917-49ff-8ec6-5a34b5ac9971', 'volume_name': 'volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f287bea3-022d-4d39-a529-392e762fa20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f287bea3-022d-4d39-a529-392e762fa20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c935a9-e117-4a25-b072-b0b12b1ba0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:10 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Volume 4c89faf8-4917-49ff-8ec6-5a34b5ac9971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971', 'volume_size': 1} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:10 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 Sep 11 23:14:10 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:11 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (84c01ed9-cdfe-4af9-a4f4-33f3720c13aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf897dd-c8c9-471a-86f0-18ed7c130ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1459435691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68080be9-2cba-4da1-8fcd-a9749a614155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:10Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Creating volume 68080be9-2cba-4da1-8fcd-a9749a614155 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:11 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf897dd-c8c9-471a-86f0-18ed7c130ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226968697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcc1825-f967-40a6-ae9a-9967771c8c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:11Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6016290-f2f8-4198-8365-b365308c34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 1073741824 Sep 11 23:14:11 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6016290-f2f8-4198-8365-b365308c34dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e52b768-9798-4fac-82cd-f7312855e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e52b768-9798-4fac-82cd-f7312855e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcc1825-f967-40a6-ae9a-9967771c8c8d', 'volume_name': 'volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c90ec5-bfb5-49cd-93ee-5d09e606ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c90ec5-bfb5-49cd-93ee-5d09e606ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e35f43-c5ab-471e-9f95-6a72ff4d040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Volume 2bcc1825-f967-40a6-ae9a-9967771c8c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d', 'volume_size': 1} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cba262-9006-4fc3-b14b-aec82f13d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12800601-56a0-4451-b4d6-d8f18bdff753', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a4c5f0-5f5f-4e1e-a18e-f00a01927558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Volume volume-12800601-56a0-4451-b4d6-d8f18bdff753 (12800601-56a0-4451-b4d6-d8f18bdff753): created successfully Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a4c5f0-5f5f-4e1e-a18e-f00a01927558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (cafe73ed-e285-437d-8b55-786d5970558d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9a8f7e4a-de09-457a-b4b4-bff49e2b7022 tempest-CreateVolumesFromImageTest-1562522097 None] Created volume successfully. Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (053f12f4-cae5-42ea-99ad-c09da74d956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945aefec-a4f6-448d-a991-1c8c892ded94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945aefec-a4f6-448d-a991-1c8c892ded94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299320019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047958c4-eda0-46a9-9f51-def21403819d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:12Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deafe074-5cd1-4322-ac18-4d6ecc322741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deafe074-5cd1-4322-ac18-4d6ecc322741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a6ce9b-5b4d-41cf-91d3-a75c3cc8a666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a6ce9b-5b4d-41cf-91d3-a75c3cc8a666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047958c4-eda0-46a9-9f51-def21403819d', 'volume_name': 'volume-047958c4-eda0-46a9-9f51-def21403819d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5888c440-18b3-4374-86b5-2a96795b6820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5888c440-18b3-4374-86b5-2a96795b6820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4c164e-9359-443f-88bb-039f6a88a927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Volume 047958c4-eda0-46a9-9f51-def21403819d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047958c4-eda0-46a9-9f51-def21403819d', 'volume_size': 1} Sep 11 23:14:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:12 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 1073741824" returned: 0 in 0.679s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:12 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 Sep 11 23:14:12 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:12 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155" returned: 0 in 0.309s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778209962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c89faf8-4917-49ff-8ec6-5a34b5ac9971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:11Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Creating volume 4c89faf8-4917-49ff-8ec6-5a34b5ac9971 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:12 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef20f5c-b38b-4f8a-8d91-c6965913b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68080be9-2cba-4da1-8fcd-a9749a614155', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e04f48-ad77-429f-8aa0-ef021876e52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:12 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 1073741824 Sep 11 23:14:12 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Volume volume-68080be9-2cba-4da1-8fcd-a9749a614155 (68080be9-2cba-4da1-8fcd-a9749a614155): created successfully Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e04f48-ad77-429f-8aa0-ef021876e52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (9937d0c9-fa30-4bd1-8312-21d8ad72be86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6ed7b567-5cba-460e-90ee-d80913a512cb tempest-CreateVolumesFromImageTest-1562522097 None] Created volume successfully. Sep 11 23:14:12 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 1073741824" returned: 0 in 0.598s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:13 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 Sep 11 23:14:13 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:13 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971" returned: 0 in 0.273s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226968697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcc1825-f967-40a6-ae9a-9967771c8c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:11Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Creating volume 2bcc1825-f967-40a6-ae9a-9967771c8c8d {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:13 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c935a9-e117-4a25-b072-b0b12b1ba0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d8315-f608-4152-95d5-082b587be617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:13 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d 1073741824 Sep 11 23:14:13 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Volume volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 (4c89faf8-4917-49ff-8ec6-5a34b5ac9971): created successfully Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d8315-f608-4152-95d5-082b587be617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (02076845-c3ca-4247-bf05-adf91aa5baec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-83b09518-9b11-4a3b-b7c0-f17e77661613 tempest-CreateVolumesFromImageTest-1562522097 None] Created volume successfully. Sep 11 23:14:13 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d 1073741824" returned: 0 in 0.497s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:13 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d Sep 11 23:14:13 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:14 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299320019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047958c4-eda0-46a9-9f51-def21403819d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbdc050db3445e1b68daf6230172aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:12Z,use_quota=True,user_id='77d814df5062400bbb6c10a3a7fbf4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Creating volume 047958c4-eda0-46a9-9f51-def21403819d {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:14 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e35f43-c5ab-471e-9f95-6a72ff4d040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:14 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d 1073741824 Sep 11 23:14:14 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d286d7c6-23f6-4c5c-a0dc-afa051ff5b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:14 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Volume volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d (2bcc1825-f967-40a6-ae9a-9967771c8c8d): created successfully Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d286d7c6-23f6-4c5c-a0dc-afa051ff5b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (84c01ed9-cdfe-4af9-a4f4-33f3720c13aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dc4d2a9b-9d02-4752-a4f4-5dbcefd9432b tempest-CreateVolumesFromImageTest-1562522097 None] Created volume successfully. Sep 11 23:14:14 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d 1073741824" returned: 0 in 0.647s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:14 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d Sep 11 23:14:14 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:15 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d" returned: 0 in 0.310s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4c164e-9359-443f-88bb-039f6a88a927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047958c4-eda0-46a9-9f51-def21403819d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a81b820-6cba-4eb3-9683-ac0ddb550ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Volume volume-047958c4-eda0-46a9-9f51-def21403819d (047958c4-eda0-46a9-9f51-def21403819d): created successfully Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a81b820-6cba-4eb3-9683-ac0ddb550ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Flow 'volume_create_manager' (053f12f4-cae5-42ea-99ad-c09da74d956f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5997767e-9d44-4626-b26c-fb3f76cd144a tempest-CreateVolumesFromImageTest-1562522097 None] Created volume successfully. Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-047958c4-eda0-46a9-9f51-def21403819d-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-047958c4-eda0-46a9-9f51-def21403819d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-quobyte-047958c4-eda0-46a9-9f51-def21403819d" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-047958c4-eda0-46a9-9f51-def21403819d" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ee170d-0c49-43f4-baf9-0ef9784f0134]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:16 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d Sep 11 23:14:16 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:16 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d" returned: 0 in 0.442s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:16 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d Sep 11 23:14:16 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:17 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-047958c4-eda0-46a9-9f51-def21403819d" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-047958c4-eda0-46a9-9f51-def21403819d" released by "delete_volume" :: held 0.817s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Created reservations ['012329ea-52b6-4186-bbab-11ccd849b890', 'b8c2cf0f-85bb-43a1-9dbb-1c2ec8f8417e', 'd783ad9a-9931-4e52-99f0-30a24a41bfe9', '65b1e357-9dff-40f9-9959-168069281899'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:17 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:17 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-2bcc1825-f967-40a6-ae9a-9967771c8c8d-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-2bcc1825-f967-40a6-ae9a-9967771c8c8d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-quobyte-2bcc1825-f967-40a6-ae9a-9967771c8c8d" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-2bcc1825-f967-40a6-ae9a-9967771c8c8d" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[929893e2-d6e1-4116-8a62-7e0b65e08da3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:17 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.377s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Deleted volume successfully. Sep 11 23:14:17 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d Sep 11 23:14:17 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f8c03097-044c-4616-971e-ca4753bbca7c tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-047958c4-eda0-46a9-9f51-def21403819d-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:18 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:18 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d Sep 11 23:14:18 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:18 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2bcc1825-f967-40a6-ae9a-9967771c8c8d" returned: 0 in 0.292s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-2bcc1825-f967-40a6-ae9a-9967771c8c8d" released by "delete_volume" :: held 0.799s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Created reservations ['55ff2eb7-6203-430d-895b-aa97c96da16a', 'c1aef1e1-e3ac-497c-817b-ecacdff86dcc', '4ef85a86-1e8a-4a37-ba1c-2be468cd1723', 'bc545abc-980c-4f6e-9272-c30f2924f6eb'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:18 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:18 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-4c89faf8-4917-49ff-8ec6-5a34b5ac9971-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-4c89faf8-4917-49ff-8ec6-5a34b5ac9971-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:18 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.298s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-quobyte-4c89faf8-4917-49ff-8ec6-5a34b5ac9971" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Deleted volume successfully. Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-4c89faf8-4917-49ff-8ec6-5a34b5ac9971" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-32062fd7-1270-465f-b97c-ad9bf53082a7 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-2bcc1825-f967-40a6-ae9a-9967771c8c8d-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511213e-db74-4e08-91f8-0dfa1d134021]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:19 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 Sep 11 23:14:19 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:19 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971" returned: 0 in 0.448s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:19 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971 Sep 11 23:14:19 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:19 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4c89faf8-4917-49ff-8ec6-5a34b5ac9971" returned: 0 in 0.293s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-4c89faf8-4917-49ff-8ec6-5a34b5ac9971" released by "delete_volume" :: held 0.795s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Created reservations ['f1837080-8b26-404d-ba9c-a6dc2db59211', '72369c71-0631-4cd7-b0e3-187fd2cde041', '1680c63e-7785-43a2-9fac-b9a79baee544', '2f2c367e-0587-4030-84c9-9dde6b5e6493'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:19 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:19 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-68080be9-2cba-4da1-8fcd-a9749a614155-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-68080be9-2cba-4da1-8fcd-a9749a614155-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-quobyte-68080be9-2cba-4da1-8fcd-a9749a614155" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-68080be9-2cba-4da1-8fcd-a9749a614155" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8fa167-4c82-44b7-be37-f28d09bcb1bf]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:20 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:20 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Deleted volume successfully. Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-25ac02ed-08e4-4b0a-a666-1b184ef384e5 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-4c89faf8-4917-49ff-8ec6-5a34b5ac9971-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:20 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 Sep 11 23:14:20 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:20 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155" returned: 0 in 0.428s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:20 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155 Sep 11 23:14:20 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:20 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68080be9-2cba-4da1-8fcd-a9749a614155" returned: 0 in 0.288s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-68080be9-2cba-4da1-8fcd-a9749a614155" released by "delete_volume" :: held 0.779s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Created reservations ['806f370f-05e5-40e3-a212-ac81e473bbb5', '53f9d079-2828-45cf-9e2d-129881c4cae2', '0f36e88f-0d64-4d28-af5b-2b08b2aadce2', '0d42a2a1-cc83-4191-a879-1288a2896490'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:21 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:21 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-12800601-56a0-4451-b4d6-d8f18bdff753-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-12800601-56a0-4451-b4d6-d8f18bdff753-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "cinder-quobyte-12800601-56a0-4451-b4d6-d8f18bdff753" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-12800601-56a0-4451-b4d6-d8f18bdff753" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[193bf54a-c7d4-4473-a8d0-668dd4085026]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:21 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 Sep 11 23:14:21 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:21 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.423s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Deleted volume successfully. Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7f0a56d9-6c5f-4a3f-b854-9a8cbb087358 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-68080be9-2cba-4da1-8fcd-a9749a614155-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:21 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753" returned: 0 in 0.442s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:21 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753 Sep 11 23:14:21 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:22 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-12800601-56a0-4451-b4d6-d8f18bdff753" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-quobyte-12800601-56a0-4451-b4d6-d8f18bdff753" released by "delete_volume" :: held 0.856s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Created reservations ['a9be870c-15d2-4148-a774-480a413eb2dc', 'a0d32e76-5558-43c2-ac23-03093ca76212', '5d9020bc-5e65-4422-98c1-6237a1175b9a', '3aa7a9ef-84e1-4202-8568-9b7747c64097'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:22 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:22 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:22 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:22 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Deleted volume successfully. Sep 11 23:14:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d4c3ba1c-c3ff-4b36-98e7-1a1aee8dbc09 tempest-CreateVolumesFromImageTest-1562522097 None] Lock "cinder-12800601-56a0-4451-b4d6-d8f18bdff753-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (4dd5a308-c3f1-4aea-8355-a084cc783e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bbabcc-8bfb-4d80-860c-c006ca979cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bbabcc-8bfb-4d80-860c-c006ca979cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382069031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a71df9-018c-4f0b-9c03-9bbbdbb2d22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:31Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae50579-71ef-4ee3-9b8f-8ae056124bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae50579-71ef-4ee3-9b8f-8ae056124bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98494256-0450-4a43-a603-0bc0b6a841dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98494256-0450-4a43-a603-0bc0b6a841dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a71df9-018c-4f0b-9c03-9bbbdbb2d22c', 'volume_name': 'volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa83aaa-0b89-413d-8150-acbf1df1e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa83aaa-0b89-413d-8150-acbf1df1e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129fef94-9017-457d-afb4-58d4e4321e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume 95a71df9-018c-4f0b-9c03-9bbbdbb2d22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c', 'volume_size': 1} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382069031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a71df9-018c-4f0b-9c03-9bbbdbb2d22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:31Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Creating volume 95a71df9-018c-4f0b-9c03-9bbbdbb2d22c {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:31 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:31 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c 1073741824 Sep 11 23:14:31 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:31 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c 1073741824" returned: 0 in 0.555s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:32 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c Sep 11 23:14:32 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:32 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c" returned: 0 in 0.296s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129fef94-9017-457d-afb4-58d4e4321e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae7e0e9-38de-4817-b347-46e27f0189c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:32 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c (95a71df9-018c-4f0b-9c03-9bbbdbb2d22c): created successfully Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae7e0e9-38de-4817-b347-46e27f0189c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (4dd5a308-c3f1-4aea-8355-a084cc783e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-714ad530-e094-429e-9f11-8ba0fa3820fe tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created volume successfully. Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (7a6d2220-fcc5-4a1e-98e5-2147ad24ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c64c62a-c823-468a-b345-29bb6c9ef208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c64c62a-c823-468a-b345-29bb6c9ef208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726761343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a653e05-de96-40b4-b533-2842ccf2f542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:34Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3021b265-ddf1-449c-8c3a-374bcf640155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3021b265-ddf1-449c-8c3a-374bcf640155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803a8acc-9ea6-4c82-a112-7e0339c14977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803a8acc-9ea6-4c82-a112-7e0339c14977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a653e05-de96-40b4-b533-2842ccf2f542', 'volume_name': 'volume-4a653e05-de96-40b4-b533-2842ccf2f542', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36446512-f82b-493e-bc5d-a12d1d544cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36446512-f82b-493e-bc5d-a12d1d544cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060c25e1-1694-44a1-bf3d-ea0ffae8e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume 4a653e05-de96-40b4-b533-2842ccf2f542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a653e05-de96-40b4-b533-2842ccf2f542', 'volume_size': 1} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726761343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a653e05-de96-40b4-b533-2842ccf2f542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:34Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Creating volume 4a653e05-de96-40b4-b533-2842ccf2f542 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:34 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:34 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 1073741824 Sep 11 23:14:34 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (05a20566-8171-4702-9440-7e8843703072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1e5a2e-be58-4a04-a3d2-0425d215a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1e5a2e-be58-4a04-a3d2-0425d215a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1770087483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86791e-87b7-4555-abc2-daec449f38c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:35Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b115b6bd-4456-4da8-a530-1e0367dcb05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b115b6bd-4456-4da8-a530-1e0367dcb05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b877ac08-437a-496b-9445-03891d4e1dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b877ac08-437a-496b-9445-03891d4e1dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb86791e-87b7-4555-abc2-daec449f38c3', 'volume_name': 'volume-bb86791e-87b7-4555-abc2-daec449f38c3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ef907d-d115-4ab0-860d-d8c0c89ff7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ef907d-d115-4ab0-860d-d8c0c89ff7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0250b1-4b9e-4cc7-b04c-92853c716857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:34 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume bb86791e-87b7-4555-abc2-daec449f38c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb86791e-87b7-4555-abc2-daec449f38c3', 'volume_size': 1} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:34 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 1073741824" returned: 0 in 0.772s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:34 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 Sep 11 23:14:34 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (d8244b50-9455-4219-a5a2-a9232b82963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b8b7e2-79ef-49bd-940f-d55c04b7990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b8b7e2-79ef-49bd-940f-d55c04b7990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1566596683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad68977-0650-47c8-8384-a0f0a4896cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:35Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4a3b3f-fa83-4ba4-adb0-69fadd3a8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4a3b3f-fa83-4ba4-adb0-69fadd3a8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0254acfb-99b3-40d3-8620-043b430996e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0254acfb-99b3-40d3-8620-043b430996e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad68977-0650-47c8-8384-a0f0a4896cd4', 'volume_name': 'volume-cad68977-0650-47c8-8384-a0f0a4896cd4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c739a7-ae83-42ae-9ff6-2065f83cd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c739a7-ae83-42ae-9ff6-2065f83cd205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e52e27-f792-4a33-aba2-bf46e9c1b30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume cad68977-0650-47c8-8384-a0f0a4896cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad68977-0650-47c8-8384-a0f0a4896cd4', 'volume_size': 1} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:35 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542" returned: 0 in 0.482s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1770087483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86791e-87b7-4555-abc2-daec449f38c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:35Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Creating volume bb86791e-87b7-4555-abc2-daec449f38c3 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:35 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060c25e1-1694-44a1-bf3d-ea0ffae8e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a653e05-de96-40b4-b533-2842ccf2f542', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aed1094-e589-46f4-9e09-9cd96089a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 1073741824 Sep 11 23:14:35 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume volume-4a653e05-de96-40b4-b533-2842ccf2f542 (4a653e05-de96-40b4-b533-2842ccf2f542): created successfully Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aed1094-e589-46f4-9e09-9cd96089a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (7a6d2220-fcc5-4a1e-98e5-2147ad24ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f72ab8bf-7c7d-4884-b112-f3dbabc66dc3 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created volume successfully. Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (299f2515-4079-4add-b0d4-1cd726aee8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11781488-d582-41b9-8809-52dbf326c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11781488-d582-41b9-8809-52dbf326c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-729181772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3b1954-0a50-4dfd-bb09-dfa568a8c72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:36Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6474ccf2-9387-401a-a97d-c41c05efbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6474ccf2-9387-401a-a97d-c41c05efbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4853471-1c4a-40f6-8e58-3905947050a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4853471-1c4a-40f6-8e58-3905947050a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3b1954-0a50-4dfd-bb09-dfa568a8c72d', 'volume_name': 'volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d35afb2-8e06-429c-8c0d-8b1d5b6ba227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d35afb2-8e06-429c-8c0d-8b1d5b6ba227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197f18c9-5f57-4424-9d97-6b3ce2c4968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume 7f3b1954-0a50-4dfd-bb09-dfa568a8c72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d', 'volume_size': 1} Sep 11 23:14:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:36 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 1073741824" returned: 0 in 0.677s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:36 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 Sep 11 23:14:36 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (6999caf9-9e81-44ae-a819-86fdeb6a33cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16724204-0da0-4ed7-9e85-7da8f4e3216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16724204-0da0-4ed7-9e85-7da8f4e3216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-225954054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d430ca-25eb-4ccb-a817-589d27c106f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:36Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e51bd8-668a-4005-b838-e591cc3f2728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e51bd8-668a-4005-b838-e591cc3f2728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049cf37c-443f-4847-9d9e-c1e858abf722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049cf37c-443f-4847-9d9e-c1e858abf722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d430ca-25eb-4ccb-a817-589d27c106f1', 'volume_name': 'volume-c3d430ca-25eb-4ccb-a817-589d27c106f1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac96c7d-b8af-4800-900a-83eb01f81183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac96c7d-b8af-4800-900a-83eb01f81183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b25d1cb3-7f3d-45d6-9542-9f526f20f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:36 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume c3d430ca-25eb-4ccb-a817-589d27c106f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d430ca-25eb-4ccb-a817-589d27c106f1', 'volume_size': 1} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:36 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1566596683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad68977-0650-47c8-8384-a0f0a4896cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:35Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Creating volume cad68977-0650-47c8-8384-a0f0a4896cd4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:36 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:36 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 1073741824 Sep 11 23:14:36 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0250b1-4b9e-4cc7-b04c-92853c716857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb86791e-87b7-4555-abc2-daec449f38c3', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494b596c-d4f7-4d2c-86fa-85cd56e759b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:36 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume volume-bb86791e-87b7-4555-abc2-daec449f38c3 (bb86791e-87b7-4555-abc2-daec449f38c3): created successfully Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494b596c-d4f7-4d2c-86fa-85cd56e759b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (05a20566-8171-4702-9440-7e8843703072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fb84c6d5-275a-480c-bb91-6d74308008ce tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created volume successfully. Sep 11 23:14:36 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 1073741824" returned: 0 in 0.596s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:37 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 Sep 11 23:14:37 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:37 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-729181772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3b1954-0a50-4dfd-bb09-dfa568a8c72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:36Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Creating volume 7f3b1954-0a50-4dfd-bb09-dfa568a8c72d {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:37 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e52e27-f792-4a33-aba2-bf46e9c1b30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad68977-0650-47c8-8384-a0f0a4896cd4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:37 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d 1073741824 Sep 11 23:14:37 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e63eee-f58d-4ac1-b71a-2623ea29858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:37 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume volume-cad68977-0650-47c8-8384-a0f0a4896cd4 (cad68977-0650-47c8-8384-a0f0a4896cd4): created successfully Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e63eee-f58d-4ac1-b71a-2623ea29858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (d8244b50-9455-4219-a5a2-a9232b82963b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8fe031e4-d831-402a-ae23-d2057f337ad4 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created volume successfully. Sep 11 23:14:37 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d 1073741824" returned: 0 in 0.557s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:38 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d Sep 11 23:14:38 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:38 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-225954054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d430ca-25eb-4ccb-a817-589d27c106f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4ae35eb8a4aaaba99183b28e6a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:36Z,use_quota=True,user_id='aa1151b354f741f280dd9b2d8cc458ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Creating volume c3d430ca-25eb-4ccb-a817-589d27c106f1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:38 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197f18c9-5f57-4424-9d97-6b3ce2c4968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65c9f4-4cf5-47a2-a3ab-edcd04859747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:38 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 1073741824 Sep 11 23:14:38 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:38 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d (7f3b1954-0a50-4dfd-bb09-dfa568a8c72d): created successfully Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65c9f4-4cf5-47a2-a3ab-edcd04859747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:38 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (299f2515-4079-4add-b0d4-1cd726aee8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-178b5236-96e9-481e-8983-685b2249979f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created volume successfully. Sep 11 23:14:39 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 1073741824" returned: 0 in 0.608s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:39 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 Sep 11 23:14:39 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:39 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1" returned: 0 in 0.294s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b25d1cb3-7f3d-45d6-9542-9f526f20f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d430ca-25eb-4ccb-a817-589d27c106f1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da1d4f2-abd7-463f-8db6-424834fdf110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Volume volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 (c3d430ca-25eb-4ccb-a817-589d27c106f1): created successfully Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da1d4f2-abd7-463f-8db6-424834fdf110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Flow 'volume_create_manager' (6999caf9-9e81-44ae-a819-86fdeb6a33cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-a6864bcf-8c56-4682-aced-bdc5383aee2b tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created volume successfully. Sep 11 23:14:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-c3d430ca-25eb-4ccb-a817-589d27c106f1-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-c3d430ca-25eb-4ccb-a817-589d27c106f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-quobyte-c3d430ca-25eb-4ccb-a817-589d27c106f1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-c3d430ca-25eb-4ccb-a817-589d27c106f1" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa38eb6a-2593-4ff8-84c6-49a9331123a5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:41 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 Sep 11 23:14:41 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:41 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1" returned: 0 in 0.482s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:41 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1 Sep 11 23:14:41 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:41 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c3d430ca-25eb-4ccb-a817-589d27c106f1" returned: 0 in 0.301s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-c3d430ca-25eb-4ccb-a817-589d27c106f1" released by "delete_volume" :: held 0.859s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created reservations ['f37a8e67-242a-4992-a245-b796f966e6a4', 'cd0af04f-49cc-4cf8-996e-5782be51658d', 'f534e359-f556-471d-be93-7fa9f22480e5', '1a24ef2d-c3b4-4099-8dd7-39f2958b934f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:42 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:42 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:42 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.375s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:42 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Deleted volume successfully. Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-872b11d9-3cbd-46f3-ae4f-696caa20b3d2 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-c3d430ca-25eb-4ccb-a817-589d27c106f1-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Flow 'volume_create_manager' (e21dc7ec-fadf-4718-b64a-663464a96b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b8f25d-8853-4d5f-affe-d02496bbba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b8f25d-8853-4d5f-affe-d02496bbba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2044516561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefdc6fe77eb45f28cddcaff7a669a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:42Z,use_quota=True,user_id='b9d27cbaa3c34d11b8d51b75fd906434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc5bac-b9b2-4c6e-ac69-83dfe2024757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc5bac-b9b2-4c6e-ac69-83dfe2024757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba3d7bb-e0e3-4f17-a421-48347d8c24dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba3d7bb-e0e3-4f17-a421-48347d8c24dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c', 'volume_name': 'volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dadeca-2c75-4879-aea5-fcd9f02285b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dadeca-2c75-4879-aea5-fcd9f02285b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37432297-e50a-40b5-9c29-281d586ddd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Volume ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c', 'volume_size': 1} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2044516561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefdc6fe77eb45f28cddcaff7a669a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:42Z,use_quota=True,user_id='b9d27cbaa3c34d11b8d51b75fd906434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Creating volume ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:42 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:42 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c 1073741824 Sep 11 23:14:42 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Flow 'volume_create_manager' (b2f46c40-fd7d-432f-a8d0-19ae0579f3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892caa4b-27fe-4c84-bf02-409894343bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892caa4b-27fe-4c84-bf02-409894343bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-880023216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f21a3f-d566-4695-9f03-b3bf5e1f069e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefdc6fe77eb45f28cddcaff7a669a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:43Z,use_quota=True,user_id='b9d27cbaa3c34d11b8d51b75fd906434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0419e051-03f9-46c9-b624-6caa16f51a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0419e051-03f9-46c9-b624-6caa16f51a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428c7e4f-f5b2-43da-9f8c-83f0b2950da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428c7e4f-f5b2-43da-9f8c-83f0b2950da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f21a3f-d566-4695-9f03-b3bf5e1f069e', 'volume_name': 'volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb55ba2f-2633-4025-b49a-e57e16bd8e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb55ba2f-2633-4025-b49a-e57e16bd8e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55a29d4-6a82-479e-a7d1-ec39133a0830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:42 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Volume 26f21a3f-d566-4695-9f03-b3bf5e1f069e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e', 'volume_size': 1} Sep 11 23:14:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-quobyte-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[28698c5c-17ca-4782-aefc-9f3386fe3d7c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:43 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c 1073741824" returned: 0 in 0.730s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:43 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d Sep 11 23:14:43 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:43 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c Sep 11 23:14:43 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:43 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d" returned: 0 in 0.540s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:43 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c" returned: 0 in 0.430s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-880023216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f21a3f-d566-4695-9f03-b3bf5e1f069e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefdc6fe77eb45f28cddcaff7a669a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:43Z,use_quota=True,user_id='b9d27cbaa3c34d11b8d51b75fd906434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Creating volume 26f21a3f-d566-4695-9f03-b3bf5e1f069e {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:43 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:43 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d Sep 11 23:14:43 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37432297-e50a-40b5-9c29-281d586ddd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f50b261-f03c-459d-8673-01593ace77ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:43 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e 1073741824 Sep 11 23:14:43 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:43 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Volume volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c (ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c): created successfully Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f50b261-f03c-459d-8673-01593ace77ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Flow 'volume_create_manager' (e21dc7ec-fadf-4718-b64a-663464a96b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:43 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-252bb06b-aec2-4019-adab-52ef670feb2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Created volume successfully. Sep 11 23:14:44 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d" returned: 0 in 0.403s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d" released by "delete_volume" :: held 1.010s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created reservations ['50d599fe-cc0b-44f6-9339-308a73ade3f3', 'fe1ced70-89c7-4809-94c2-452e1110fe7a', '82564f02-2291-4a9e-8ca9-df5c5da18fbf', '75e083f6-28b6-4da9-b3a2-6f01b19a85b0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:44 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:44 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:44 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e 1073741824" returned: 0 in 0.705s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:44 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e Sep 11 23:14:44 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:44 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Deleted volume successfully. Sep 11 23:14:44 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecede45-e03c-47ed-98f9-f9cf6c912370 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-7f3b1954-0a50-4dfd-bb09-dfa568a8c72d-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:45 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e" returned: 0 in 0.426s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55a29d4-6a82-479e-a7d1-ec39133a0830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d75c22-ca33-44a9-b83f-d4a4c9e321ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:45 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Volume volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e (26f21a3f-d566-4695-9f03-b3bf5e1f069e): created successfully Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d75c22-ca33-44a9-b83f-d4a4c9e321ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Flow 'volume_create_manager' (b2f46c40-fd7d-432f-a8d0-19ae0579f3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-18ee69b8-961f-438e-907d-3ef126564dec tempest-TestServerVolumeAttachmentScenario-828481600 None] Created volume successfully. Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-cad68977-0650-47c8-8384-a0f0a4896cd4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-cad68977-0650-47c8-8384-a0f0a4896cd4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-quobyte-cad68977-0650-47c8-8384-a0f0a4896cd4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-cad68977-0650-47c8-8384-a0f0a4896cd4" acquired by "delete_volume" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115a782-da05-483e-a4c9-52bf3c0a7dfa]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:45 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 Sep 11 23:14:45 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:46 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4" returned: 0 in 0.408s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:46 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4 Sep 11 23:14:46 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:46 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-cad68977-0650-47c8-8384-a0f0a4896cd4" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-cad68977-0650-47c8-8384-a0f0a4896cd4" released by "delete_volume" :: held 0.720s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created reservations ['c738ad67-7308-4172-9cc1-5b2e64c4eab4', '5e7a00fa-372f-4acb-8f12-abb65d53bce1', 'a33df025-bccd-49b4-a28e-700dde6c28a5', '437b6c9a-c1fc-432b-9dc6-ddf66ea0c635'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:46 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:46 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-bb86791e-87b7-4555-abc2-daec449f38c3-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-bb86791e-87b7-4555-abc2-daec449f38c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:46 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.299s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:46 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Deleted volume successfully. Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-44f5b5e7-2547-433e-ba8a-4d1ae0012251 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-cad68977-0650-47c8-8384-a0f0a4896cd4-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-quobyte-bb86791e-87b7-4555-abc2-daec449f38c3" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-bb86791e-87b7-4555-abc2-daec449f38c3" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a90af5-95ee-4553-9098-b651578a2605]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:47 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 Sep 11 23:14:47 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:47 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:47 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3 Sep 11 23:14:47 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:47 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bb86791e-87b7-4555-abc2-daec449f38c3" returned: 0 in 0.264s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-bb86791e-87b7-4555-abc2-daec449f38c3" released by "delete_volume" :: held 0.724s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=121,cinder:UPDATE=152,cinder:DELETE=8,cinder:INSERT=42 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=106,cinder:INSERT=35,cinder:UPDATE=153,cinder:DELETE=20 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created reservations ['f92fd03d-ddc5-431f-9c79-4f4179bda023', '119e6314-cc60-4629-a283-c266a2e45e5b', '1cbc3a68-6fd7-4019-8d88-34afde7400b3', 'f4b35b92-f262-48ca-bfa1-a28653486ec4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:47 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:47 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-4a653e05-de96-40b4-b533-2842ccf2f542-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-4a653e05-de96-40b4-b533-2842ccf2f542-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:48 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-quobyte-4a653e05-de96-40b4-b533-2842ccf2f542" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Deleted volume successfully. Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-4a653e05-de96-40b4-b533-2842ccf2f542" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5fb6013-ab7c-4722-8f4c-2f3adddf059f tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-bb86791e-87b7-4555-abc2-daec449f38c3-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dbb870-48bd-49f1-8cb7-b36d903a7bda]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:48 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 Sep 11 23:14:48 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:48 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542" returned: 0 in 0.517s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:48 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542 Sep 11 23:14:48 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:49 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4a653e05-de96-40b4-b533-2842ccf2f542" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-4a653e05-de96-40b4-b533-2842ccf2f542" released by "delete_volume" :: held 0.891s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created reservations ['d0b96ee9-7fe0-44a5-a426-3f73af5f1f32', '302b4b94-f1be-4116-b325-28a1c808bd06', '6c947489-a2ff-48a3-95c8-492b44603503', 'b0506a51-1b66-4664-99bb-b5d9f52cca0e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:49 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:49 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:49 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.331s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Deleted volume successfully. Sep 11 23:14:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-330affe8-6ab5-46c7-b3e6-2d11e08bef09 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-4a653e05-de96-40b4-b533-2842ccf2f542-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "cinder-quobyte-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa838b-c2d7-4e7e-9312-09ee78a6759e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:50 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c Sep 11 23:14:50 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:51 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c" returned: 0 in 0.643s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:51 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c Sep 11 23:14:51 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:51 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c" returned: 0 in 0.394s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-quobyte-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c" released by "delete_volume" :: held 1.146s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Created reservations ['23d4e9be-d7f7-4702-928a-90062da19d94', 'd1e9b78f-3b96-4d02-afe4-220c6c6cdc30', '7c891cc7-7e77-4027-b705-d5578dc9ab68', '96e05140-fcd2-43c7-9e2c-5249f1366f7f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:51 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:51 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:52 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.378s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:52 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Deleted volume successfully. Sep 11 23:14:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d4b002a-139f-410d-a93b-666b12c21201 tempest-CreateVolumesFromSourceVolumeTest-1300002469 None] Lock "cinder-95a71df9-018c-4f0b-9c03-9bbbdbb2d22c-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:59 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:14:59 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:59 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.518s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:14:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Flow 'volume_create_manager' (cf7fe7d8-7fcd-46aa-b86f-43b75bfcc8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98fd4be-a4f9-4444-9bc6-0b8695cbec9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98fd4be-a4f9-4444-9bc6-0b8695cbec9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960474013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d69df4-c864-4b74-b603-0022c1a08b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9edc7aa464ab8b6e57e34319bd9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:00Z,use_quota=True,user_id='a7cdc23f19c842fe93fa04278610d8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cce8bb-a10c-4ae9-9729-8a150c96f2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cce8bb-a10c-4ae9-9729-8a150c96f2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20bcd28-29bc-4a29-9276-305723534f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20bcd28-29bc-4a29-9276-305723534f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d69df4-c864-4b74-b603-0022c1a08b4a', 'volume_name': 'volume-57d69df4-c864-4b74-b603-0022c1a08b4a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0992638e-8db5-47a4-b01e-b456543129a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0992638e-8db5-47a4-b01e-b456543129a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fe22b2-cf31-4ea1-a6d2-8454fa09f626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Volume 57d69df4-c864-4b74-b603-0022c1a08b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d69df4-c864-4b74-b603-0022c1a08b4a', 'volume_size': 1} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960474013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d69df4-c864-4b74-b603-0022c1a08b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9edc7aa464ab8b6e57e34319bd9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:00Z,use_quota=True,user_id='a7cdc23f19c842fe93fa04278610d8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Creating volume 57d69df4-c864-4b74-b603-0022c1a08b4a {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:00 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:00 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a 1073741824 Sep 11 23:15:00 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:00 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a 1073741824" returned: 0 in 0.732s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:00 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a Sep 11 23:15:00 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:01 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a" returned: 0 in 0.342s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fe22b2-cf31-4ea1-a6d2-8454fa09f626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d69df4-c864-4b74-b603-0022c1a08b4a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485e9c7f-56ca-4943-9bfc-6596cd2a90bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Volume volume-57d69df4-c864-4b74-b603-0022c1a08b4a (57d69df4-c864-4b74-b603-0022c1a08b4a): created successfully Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485e9c7f-56ca-4943-9bfc-6596cd2a90bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Flow 'volume_create_manager' (cf7fe7d8-7fcd-46aa-b86f-43b75bfcc8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f5679ed4-d900-4a0d-8df5-ec291794bdd6 tempest-ProjectReaderTests-1604909691 None] Created volume successfully. Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Flow 'volume_create_manager' (d015fd4d-b0ee-4888-8e24-8e660c11a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f02856-206d-486d-aaaa-3d208222cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f02856-206d-486d-aaaa-3d208222cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1044402050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c3481c-614e-40bb-848d-37f113b666a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2ace2b74bc4ed3a5022fbdf1a12fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:02Z,use_quota=True,user_id='b3471958ed954a629f514e8b7651102f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e767b16-4493-4d53-8ba8-99b6682add85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e767b16-4493-4d53-8ba8-99b6682add85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0714bd32-6141-4d83-abf1-1369aaa7dc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0714bd32-6141-4d83-abf1-1369aaa7dc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c3481c-614e-40bb-848d-37f113b666a6', 'volume_name': 'volume-b9c3481c-614e-40bb-848d-37f113b666a6', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638f16cf-3246-4c91-b1ec-098c4256f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638f16cf-3246-4c91-b1ec-098c4256f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afd3eb9-e4d3-4f93-ae35-3e89caa8c8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Volume b9c3481c-614e-40bb-848d-37f113b666a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c3481c-614e-40bb-848d-37f113b666a6', 'volume_size': 1} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1044402050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c3481c-614e-40bb-848d-37f113b666a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2ace2b74bc4ed3a5022fbdf1a12fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:02Z,use_quota=True,user_id='b3471958ed954a629f514e8b7651102f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Creating volume b9c3481c-614e-40bb-848d-37f113b666a6 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:02 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:02 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 1073741824 Sep 11 23:15:02 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Acquiring lock "cinder-57d69df4-c864-4b74-b603-0022c1a08b4a-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Lock "cinder-57d69df4-c864-4b74-b603-0022c1a08b4a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Acquiring lock "cinder-quobyte-57d69df4-c864-4b74-b603-0022c1a08b4a" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Lock "cinder-quobyte-57d69df4-c864-4b74-b603-0022c1a08b4a" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab81484a-87d4-4532-a8fe-28d312bcbefa]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:02 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a Sep 11 23:15:02 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:02 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 1073741824" returned: 0 in 0.510s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:03 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 Sep 11 23:15:03 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:03 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a" returned: 0 in 0.473s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:03 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a Sep 11 23:15:03 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:03 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6" returned: 0 in 0.296s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afd3eb9-e4d3-4f93-ae35-3e89caa8c8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c3481c-614e-40bb-848d-37f113b666a6', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fca789-7f38-47db-8663-d5540ea2db51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Volume volume-b9c3481c-614e-40bb-848d-37f113b666a6 (b9c3481c-614e-40bb-848d-37f113b666a6): created successfully Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fca789-7f38-47db-8663-d5540ea2db51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Flow 'volume_create_manager' (d015fd4d-b0ee-4888-8e24-8e660c11a28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-878db523-6df6-41aa-bb6e-52e2be37304b tempest-TestMinimumBasicScenario-1788830031 None] Created volume successfully. Sep 11 23:15:03 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57d69df4-c864-4b74-b603-0022c1a08b4a" returned: 0 in 0.304s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Lock "cinder-quobyte-57d69df4-c864-4b74-b603-0022c1a08b4a" released by "delete_volume" :: held 0.822s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Created reservations ['5d04d4bd-7aeb-4b16-9448-72eb110b90e0', '5964603b-48b1-457e-9693-acb42b0e9a7f', 'e1396f0a-fa7a-48c0-9d35-b5a56f6ddae4', '108bbfd1-87f8-4b5c-a6c4-7ee43d5300b9'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:03 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:15:03 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:03 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Deleted volume successfully. Sep 11 23:15:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6ba2581c-3103-4c1c-834a-9c3c14c94e3b tempest-ProjectReaderTests-1604909691 None] Lock "cinder-57d69df4-c864-4b74-b603-0022c1a08b4a-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Flow 'volume_create_manager' (4817eb37-d24d-4088-b542-bee328a996b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b92ce1-f247-44de-9704-4e1d492b535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b92ce1-f247-44de-9704-4e1d492b535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861783676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9edc7aa464ab8b6e57e34319bd9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:04Z,use_quota=True,user_id='a7cdc23f19c842fe93fa04278610d8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ad479-beed-4b07-a77e-9829416a0897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ad479-beed-4b07-a77e-9829416a0897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce7da4d-530c-4ac2-bd27-bb541541069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce7da4d-530c-4ac2-bd27-bb541541069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f', 'volume_name': 'volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716fec7e-946e-419f-bf01-162a8c69028c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716fec7e-946e-419f-bf01-162a8c69028c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7659c011-7790-463d-af6b-231c4ffd345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:04 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Volume 6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f', 'volume_size': 1} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861783676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f9edc7aa464ab8b6e57e34319bd9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:04Z,use_quota=True,user_id='a7cdc23f19c842fe93fa04278610d8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Creating volume 6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:04 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:04 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f 1073741824 Sep 11 23:15:04 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:04 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f 1073741824" returned: 0 in 0.557s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:05 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f Sep 11 23:15:05 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:05 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7659c011-7790-463d-af6b-231c4ffd345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc93a185-972a-47fd-a7d1-d71de20dc379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Volume volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f (6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f): created successfully Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc93a185-972a-47fd-a7d1-d71de20dc379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Flow 'volume_create_manager' (4817eb37-d24d-4088-b542-bee328a996b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f36b470c-7055-4a0a-b312-28321866dd79 tempest-ProjectReaderTests-1604909691 None] Created volume successfully. Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-84bd02ef-6459-4b6b-b1dd-e58a04ae044a req-9a63a6c2-9671-430d-ba78-8671877956c9 tempest-TestMinimumBasicScenario-1788830031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-84bd02ef-6459-4b6b-b1dd-e58a04ae044a req-9a63a6c2-9671-430d-ba78-8671877956c9 tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-84bd02ef-6459-4b6b-b1dd-e58a04ae044a req-9a63a6c2-9671-430d-ba78-8671877956c9 tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-84bd02ef-6459-4b6b-b1dd-e58a04ae044a req-9a63a6c2-9671-430d-ba78-8671877956c9 tempest-TestMinimumBasicScenario-1788830031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-b9c3481c-614e-40bb-848d-37f113b666a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dc71e1c-8315-4530-bbce-82a8eaea76fa', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:15:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-84bd02ef-6459-4b6b-b1dd-e58a04ae044a req-9a63a6c2-9671-430d-ba78-8671877956c9 tempest-TestMinimumBasicScenario-1788830031 None] attachment_update completed successfully. Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "cinder-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Lock "cinder-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "cinder-quobyte-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Lock "cinder-quobyte-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f" acquired by "delete_volume" :: waited 0.034s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe6cb9-e540-4819-b9de-c8d7db92c13a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:06 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f Sep 11 23:15:06 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:06 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:07 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f Sep 11 23:15:07 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:07 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f" returned: 0 in 0.255s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Lock "cinder-quobyte-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f" released by "delete_volume" :: held 0.675s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Created reservations ['a8ba48f4-1c23-4c39-9c72-3c592e343fbc', 'e31803c0-4a17-4cd2-9f9f-daee89003522', '7ebb2be8-e8db-4659-adcf-c3be86ebb148', '85543129-97a4-44b8-8977-7c977693e996'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:07 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:15:07 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:07 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Deleted volume successfully. Sep 11 23:15:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-827e7d98-f080-4c3c-8ae6-a9da8f826686 tempest-ProjectReaderTests-1604909691 None] Lock "cinder-6e7ff5ab-7c23-475d-b3d6-b9987e2d4c0f-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:17 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=45,cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=11 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:15:17 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=33,cinder:INSERT=12,cinder:UPDATE=55,cinder:DELETE=4 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:15:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-569fa072-d425-4120-9a2f-9fd151149b84 req-34045953-367a-4917-80a0-b34a8c2b1be1 tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-569fa072-d425-4120-9a2f-9fd151149b84 req-34045953-367a-4917-80a0-b34a8c2b1be1 tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-569fa072-d425-4120-9a2f-9fd151149b84 req-34045953-367a-4917-80a0-b34a8c2b1be1 tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-569fa072-d425-4120-9a2f-9fd151149b84 req-34045953-367a-4917-80a0-b34a8c2b1be1 tempest-TestServerVolumeAttachmentScenario-828481600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26976441-f2a0-4c21-b180-2f21c37c2b05', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:15:22 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-569fa072-d425-4120-9a2f-9fd151149b84 req-34045953-367a-4917-80a0-b34a8c2b1be1 tempest-TestServerVolumeAttachmentScenario-828481600 None] attachment_update completed successfully. Sep 11 23:15:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-ce297af5-3387-4327-8de5-a12331626c57 req-2c7b03f9-02a9-4892-bedf-7e20cc54317a tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-ce297af5-3387-4327-8de5-a12331626c57 req-2c7b03f9-02a9-4892-bedf-7e20cc54317a tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [req-ce297af5-3387-4327-8de5-a12331626c57 req-2c7b03f9-02a9-4892-bedf-7e20cc54317a tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:25 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-ce297af5-3387-4327-8de5-a12331626c57 req-2c7b03f9-02a9-4892-bedf-7e20cc54317a tempest-TestServerVolumeAttachmentScenario-828481600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd', 'name': 'volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d86e67c-fb01-4b7f-8c14-7ddd1cd915da', 'enforce_multipath': True} {{(pid=88002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:15:25 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-ce297af5-3387-4327-8de5-a12331626c57 req-2c7b03f9-02a9-4892-bedf-7e20cc54317a tempest-TestServerVolumeAttachmentScenario-828481600 None] attachment_update completed successfully. Sep 11 23:15:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-b9154ffe-eb9e-45a3-9ae3-6b360d08d89a req-24396e3f-09d4-4a4c-bb88-3b0c3bce7216 tempest-TestServerVolumeAttachmentScenario-828481600 None] Terminate volume connection completed successfully. Sep 11 23:15:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-b9154ffe-eb9e-45a3-9ae3-6b360d08d89a req-24396e3f-09d4-4a4c-bb88-3b0c3bce7216 tempest-TestServerVolumeAttachmentScenario-828481600 None] Deleting attachment 7d86e67c-fb01-4b7f-8c14-7ddd1cd915da. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:15:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-fc1d9209-a7bd-474e-ac1c-9e9762bc6e4f req-6a923615-fbc3-40c3-bc6b-a376cc9fd2e1 tempest-TestServerVolumeAttachmentScenario-828481600 None] Terminate volume connection completed successfully. Sep 11 23:15:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-fc1d9209-a7bd-474e-ac1c-9e9762bc6e4f req-6a923615-fbc3-40c3-bc6b-a376cc9fd2e1 tempest-TestServerVolumeAttachmentScenario-828481600 None] Deleting attachment 26976441-f2a0-4c21-b180-2f21c37c2b05. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "cinder-26f21a3f-d566-4695-9f03-b3bf5e1f069e-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-26f21a3f-d566-4695-9f03-b3bf5e1f069e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "cinder-quobyte-26f21a3f-d566-4695-9f03-b3bf5e1f069e" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-quobyte-26f21a3f-d566-4695-9f03-b3bf5e1f069e" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4288c8ed-3b34-4213-80b5-29dec3d62360]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:33 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e Sep 11 23:15:33 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:33 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e" returned: 0 in 0.346s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:33 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e Sep 11 23:15:33 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:34 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-26f21a3f-d566-4695-9f03-b3bf5e1f069e" returned: 0 in 0.229s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-quobyte-26f21a3f-d566-4695-9f03-b3bf5e1f069e" released by "delete_volume" :: held 0.618s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Created reservations ['39766a02-a08e-4c74-99b8-8384400e4e64', '0321ed88-9c5c-45a5-9a9e-d2a73f40da10', 'becece33-9330-48a8-9b0e-d157cc8126a9', 'f7b7eb5d-6a66-4e4f-a1c1-b155265c9caf'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:34 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:15:34 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:34 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Deleted volume successfully. Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8886a0a8-d4db-4cd5-88a4-32082824774b tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-26f21a3f-d566-4695-9f03-b3bf5e1f069e-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "cinder-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "cinder-quobyte-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-quobyte-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cc2585-3f6d-4d58-b4ec-f4b0602db3dd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:34 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c Sep 11 23:15:34 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:35 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:35 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c Sep 11 23:15:35 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:35 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-quobyte-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c" released by "delete_volume" :: held 0.627s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Created reservations ['f1abb076-99b1-4104-ac3a-f8838476dea3', 'f851fdd9-1b42-4fa4-8111-e032da759685', 'c8a3a4a8-46b1-44f4-824d-4c7cfe764582', '4aab2311-feef-4220-9445-175135b033e4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:35 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:15:35 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:35 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.228s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Deleted volume successfully. Sep 11 23:15:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-538d0337-5740-4681-ae53-ffb0cfad5f2e tempest-TestServerVolumeAttachmentScenario-828481600 None] Lock "cinder-ef5b3a87-6e5b-43e4-a4bf-8db2dcfd316c-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:45 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=5 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:15:45 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:15:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [req-6cf35a9f-44a7-4cfb-b4de-e345d21f5a80 req-30a6802a-882a-4e56-889f-810680891f60 tempest-TestMinimumBasicScenario-1788830031 None] Terminate volume connection completed successfully. Sep 11 23:15:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [req-6cf35a9f-44a7-4cfb-b4de-e345d21f5a80 req-30a6802a-882a-4e56-889f-810680891f60 tempest-TestMinimumBasicScenario-1788830031 None] Deleting attachment 3dc71e1c-8315-4530-bbce-82a8eaea76fa. {{(pid=88002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:15:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Acquiring lock "cinder-b9c3481c-614e-40bb-848d-37f113b666a6-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Lock "cinder-b9c3481c-614e-40bb-848d-37f113b666a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Acquiring lock "cinder-quobyte-b9c3481c-614e-40bb-848d-37f113b666a6" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Lock "cinder-quobyte-b9c3481c-614e-40bb-848d-37f113b666a6" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e648327-ab90-4653-b59b-ae17772c1172]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:53 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 Sep 11 23:15:53 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:54 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6" returned: 0 in 0.416s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:54 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6 Sep 11 23:15:54 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:54 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-b9c3481c-614e-40bb-848d-37f113b666a6" returned: 0 in 0.290s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Lock "cinder-quobyte-b9c3481c-614e-40bb-848d-37f113b666a6" released by "delete_volume" :: held 0.751s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Created reservations ['81b5d532-7446-4f40-88ec-9d6c39bbb27f', 'f4f9207d-45b1-4e17-97df-5d8458525990', 'e7b38e0f-be82-445b-af5b-a782a497a544', '8a693894-5cb5-4639-9c70-6e24396698c7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:54 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:15:54 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:54 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Deleted volume successfully. Sep 11 23:15:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1768b1a5-637a-480a-aa2c-1e53602507aa tempest-TestMinimumBasicScenario-1788830031 None] Lock "cinder-b9c3481c-614e-40bb-848d-37f113b666a6-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:59 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:15:59 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:59 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:15:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:16:04 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:16:04 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Flow 'volume_create_manager' (7b52ded7-8c19-4c29-8e30-5d5a6a3ed783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4afc73-dc9d-4fca-a387-1c5810be1632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4afc73-dc9d-4fca-a387-1c5810be1632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-64829924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1a947f-8220-4529-912c-ce0703065457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2e3c505f194d668e9ddbb8c0eb35a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:05Z,use_quota=True,user_id='f9a2e4df009f4097a486471f2b7e822e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68ce731-9a02-4216-bbc9-e644a8492a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68ce731-9a02-4216-bbc9-e644a8492a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d7ac97-1eb4-4521-832e-609cd5a17ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d7ac97-1eb4-4521-832e-609cd5a17ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1a947f-8220-4529-912c-ce0703065457', 'volume_name': 'volume-be1a947f-8220-4529-912c-ce0703065457', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f2d328-e659-4eb6-a82d-03da61c360fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f2d328-e659-4eb6-a82d-03da61c360fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c705b953-2bdc-41bb-a024-e46ba3591ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Volume be1a947f-8220-4529-912c-ce0703065457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1a947f-8220-4529-912c-ce0703065457', 'volume_size': 1} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-64829924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1a947f-8220-4529-912c-ce0703065457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2e3c505f194d668e9ddbb8c0eb35a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:05Z,use_quota=True,user_id='f9a2e4df009f4097a486471f2b7e822e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Creating volume be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:05 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:05 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 1073741824 Sep 11 23:16:05 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:05 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 1073741824" returned: 0 in 0.499s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:05 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 Sep 11 23:16:05 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:06 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457" returned: 0 in 0.272s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c705b953-2bdc-41bb-a024-e46ba3591ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1a947f-8220-4529-912c-ce0703065457', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6821db-235c-45fa-895e-b32ed4d73e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Volume volume-be1a947f-8220-4529-912c-ce0703065457 (be1a947f-8220-4529-912c-ce0703065457): created successfully Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6821db-235c-45fa-895e-b32ed4d73e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Flow 'volume_create_manager' (7b52ded7-8c19-4c29-8e30-5d5a6a3ed783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6685ba6e-1323-4ded-b5fe-b42f28c630cf tempest-TestImageHashVerification-1503765153 None] Created volume successfully. Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d986606e-0485-4cd4-afea-2360af182b05]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:08 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 Sep 11 23:16:08 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:08 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457" returned: 0 in 0.364s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae6f11b-ac10-4b2d-8e68-f5bdaaf50315]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:08 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 Sep 11 23:16:08 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:08 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 /opt/stack/data/cinder/conversion/be1a947f-8220-4529-912c-ce0703065457.temp_image.a02c078a-9c90-4774-b2c8-7d00b05fbf0aqmiy_aws.img {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:08 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 /opt/stack/data/cinder/conversion/be1a947f-8220-4529-912c-ce0703065457.temp_image.a02c078a-9c90-4774-b2c8-7d00b05fbf0aqmiy_aws.img Sep 11 23:16:08 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:13 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 /opt/stack/data/cinder/conversion/be1a947f-8220-4529-912c-ce0703065457.temp_image.a02c078a-9c90-4774-b2c8-7d00b05fbf0aqmiy_aws.img" returned: 0 in 4.342s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[492cd61b-2002-497a-9ac4-9486be278d44]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:13 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 Sep 11 23:16:13 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:13 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457" returned: 0 in 0.541s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:13 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/be1a947f-8220-4529-912c-ce0703065457.temp_image.a02c078a-9c90-4774-b2c8-7d00b05fbf0aqmiy_aws.img {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:16:13 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Converted 1024.00 MB image at 235.75 MB/s Sep 11 23:16:13 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] a02c078a-9c90-4774-b2c8-7d00b05fbf0a was raw, no need to convert to raw {{(pid=88002) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Flow 'volume_create_manager' (dfa852a7-7a16-4615-9baf-33c1ca071e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08fd840-474e-49b2-b87a-93aeb6dad5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08fd840-474e-49b2-b87a-93aeb6dad5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3adc801-3bcb-4e21-9989-d9aeba905553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d327f89cc2a42b2872d682eb91ea2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:16Z,use_quota=True,user_id='ce2ad78e4a5e44869a55d7554d7882b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca79d98-e48d-4181-88ce-84126a34b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca79d98-e48d-4181-88ce-84126a34b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab799ae9-0862-4406-8235-4ffbbefffea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab799ae9-0862-4406-8235-4ffbbefffea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3adc801-3bcb-4e21-9989-d9aeba905553', 'volume_name': 'volume-e3adc801-3bcb-4e21-9989-d9aeba905553', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cca912d-dd68-4c15-8bcf-8eab02ae0411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cca912d-dd68-4c15-8bcf-8eab02ae0411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065aaaad-e261-4961-a4fe-cf5365c5c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Volume e3adc801-3bcb-4e21-9989-d9aeba905553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3adc801-3bcb-4e21-9989-d9aeba905553', 'volume_size': 1} Sep 11 23:16:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:23 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:INSERT=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:16:25 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.502s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Uploaded volume to glance image-id: a02c078a-9c90-4774-b2c8-7d00b05fbf0a. {{(pid=88002) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.735s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3adc801-3bcb-4e21-9989-d9aeba905553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d327f89cc2a42b2872d682eb91ea2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:16Z,use_quota=True,user_id='ce2ad78e4a5e44869a55d7554d7882b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Creating volume e3adc801-3bcb-4e21-9989-d9aeba905553 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:32 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:16:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:32 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 1073741824 Sep 11 23:16:32 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4ebaabcb-f3db-469a-9a90-e5cab3bb2065 tempest-TestImageHashVerification-1503765153 None] Copy volume to image completed successfully. Sep 11 23:16:33 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 1073741824" returned: 0 in 0.421s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:33 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 Sep 11 23:16:33 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:33 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553" returned: 0 in 0.254s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065aaaad-e261-4961-a4fe-cf5365c5c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3adc801-3bcb-4e21-9989-d9aeba905553', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d34cc1b-e817-49c4-b1c2-c11f4c6d1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:33 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Volume volume-e3adc801-3bcb-4e21-9989-d9aeba905553 (e3adc801-3bcb-4e21-9989-d9aeba905553): created successfully Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d34cc1b-e817-49c4-b1c2-c11f4c6d1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Flow 'volume_create_manager' (dfa852a7-7a16-4615-9baf-33c1ca071e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-53603fbe-1907-46ac-8c4c-763a312bf01c tempest-CinderUnicodeTest-1119584177 None] Created volume successfully. Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Acquiring lock "cinder-be1a947f-8220-4529-912c-ce0703065457-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Lock "cinder-be1a947f-8220-4529-912c-ce0703065457-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Acquiring lock "cinder-quobyte-be1a947f-8220-4529-912c-ce0703065457" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Lock "cinder-quobyte-be1a947f-8220-4529-912c-ce0703065457" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0415d6-ca8b-47cb-b95a-0d0e2f801a18]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:33 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 Sep 11 23:16:33 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:33 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:34 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457 Sep 11 23:16:34 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:34 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-be1a947f-8220-4529-912c-ce0703065457" returned: 0 in 0.251s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Lock "cinder-quobyte-be1a947f-8220-4529-912c-ce0703065457" released by "delete_volume" :: held 0.636s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Created reservations ['4c1297c5-b4f7-409e-b8f7-7b42ea8c351d', '0d500f39-abe0-4801-b509-6cb8962afcdf', 'dd018de4-04c4-46c1-81a8-083bb1048338', 'c213e089-7dc4-4714-b5a5-831191511425'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Flow 'volume_create_manager' (29337fc8-2d68-43b4-bd79-201b402403d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f64a5a8-7d24-4c2a-a689-db9e1b6d4fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:34 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f64a5a8-7d24-4c2a-a689-db9e1b6d4fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1007528005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8078d385-3d9d-4e27-84c2-0bf09c5887cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d327f89cc2a42b2872d682eb91ea2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:34Z,use_quota=True,user_id='ce2ad78e4a5e44869a55d7554d7882b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:34 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b015e890-a58b-43f6-8ea7-5600600c27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b015e890-a58b-43f6-8ea7-5600600c27d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6566cf-e961-4e35-aacb-901a3b334bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6566cf-e961-4e35-aacb-901a3b334bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8078d385-3d9d-4e27-84c2-0bf09c5887cb', 'volume_name': 'volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d78cfb-6390-41ad-ba33-ab1ad8eff1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d78cfb-6390-41ad-ba33-ab1ad8eff1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5710269e-afbb-434b-98b6-9637303e46c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:34 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Volume 8078d385-3d9d-4e27-84c2-0bf09c5887cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb', 'volume_size': 1} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1007528005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8078d385-3d9d-4e27-84c2-0bf09c5887cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d327f89cc2a42b2872d682eb91ea2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:34Z,use_quota=True,user_id='ce2ad78e4a5e44869a55d7554d7882b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Creating volume 8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:34 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:34 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb 1073741824 Sep 11 23:16:34 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:34 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Deleted volume successfully. Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-da32b055-a364-46ad-b243-871c4b882b70 tempest-TestImageHashVerification-1503765153 None] Lock "cinder-be1a947f-8220-4529-912c-ce0703065457-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:34 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb 1073741824" returned: 0 in 0.443s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:34 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb Sep 11 23:16:34 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:35 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5710269e-afbb-434b-98b6-9637303e46c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f1da8d-b7cf-4ca9-b498-37b59249ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Volume volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb (8078d385-3d9d-4e27-84c2-0bf09c5887cb): created successfully Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f1da8d-b7cf-4ca9-b498-37b59249ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Flow 'volume_create_manager' (29337fc8-2d68-43b4-bd79-201b402403d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-22138520-b177-4817-a3f7-81d54f172d39 tempest-CinderUnicodeTest-1119584177 None] Created volume successfully. Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Creating offline snapshot 186eb58f-81b6-444f-83d4-daef858d64cd of volume 8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[599ced74-e887-4cfc-9074-3aa0bbb1cd4c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:35 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb Sep 11 23:16:35 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:36 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:36 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd 1G Sep 11 23:16:36 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:36 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd 1G" returned: 0 in 0.450s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:36 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd Sep 11 23:16:36 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:36 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd" returned: 0 in 0.292s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:36 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd is being set with open permissions: ugo+rw Sep 11 23:16:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:36 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd Sep 11 23:16:36 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:37 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd" returned: 0 in 0.251s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:37 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info Sep 11 23:16:37 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:37 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info" returned: 0 in 0.265s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:37 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info is being set with open permissions: ugo+rw Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:37 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info Sep 11 23:16:37 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:37 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.info" returned: 0 in 0.239s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-50f652fa-c492-43ad-9937-62de934f4257 tempest-CinderUnicodeTest-1119584177 None] Create snapshot completed successfully Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-186eb58f-81b6-444f-83d4-daef858d64cd-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-186eb58f-81b6-444f-83d4-daef858d64cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-quobyte-8078d385-3d9d-4e27-84c2-0bf09c5887cb" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-8078d385-3d9d-4e27-84c2-0bf09c5887cb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-quobyte-186eb58f-81b6-444f-83d4-daef858d64cd" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-186eb58f-81b6-444f-83d4-daef858d64cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Deleting offline snapshot 186eb58f-81b6-444f-83d4-daef858d64cd of volume 8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] snapshot_file for this snap is: volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87438b-aad6-476d-b9d1-ce525ae0a75b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:37 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd Sep 11 23:16:37 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:38 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:16:38 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef586b96-e0b9-410b-88a4-af3e2c856f52]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:38 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb Sep 11 23:16:38 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:38 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb" returned: 0 in 0.362s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:38 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd Sep 11 23:16:38 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:39 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:39 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd Sep 11 23:16:39 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:39 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb.186eb58f-81b6-444f-83d4-daef858d64cd" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-186eb58f-81b6-444f-83d4-daef858d64cd" released by "_delete_snapshot" :: held 1.516s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-8078d385-3d9d-4e27-84c2-0bf09c5887cb" released by "delete_snapshot" :: held 1.539s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Created reservations ['5eb50907-d6fd-4659-9efd-78c0e78799c4', 'adc047f3-107b-490b-964a-e779b2e542dd', 'f9083f33-d582-4258-9304-3e5c7c554b97', '2c74a7f4-4589-4161-a213-49c33de1d964'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Delete snapshot completed successfully. Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d0aa89a-4713-42d3-b2d8-bcc82e370d68 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-186eb58f-81b6-444f-83d4-daef858d64cd-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-8078d385-3d9d-4e27-84c2-0bf09c5887cb-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-8078d385-3d9d-4e27-84c2-0bf09c5887cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-quobyte-8078d385-3d9d-4e27-84c2-0bf09c5887cb" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-8078d385-3d9d-4e27-84c2-0bf09c5887cb" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c7aa0-371f-47bf-861a-d7b98eb928ed]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:40 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb Sep 11 23:16:40 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:40 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb" returned: 0 in 0.377s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:40 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb Sep 11 23:16:40 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:40 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-8078d385-3d9d-4e27-84c2-0bf09c5887cb" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-8078d385-3d9d-4e27-84c2-0bf09c5887cb" released by "delete_volume" :: held 0.671s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Created reservations ['52f9c044-ba71-422a-ab8a-a5aa4ef13095', '3ebb7133-0e57-446a-a600-de984de52883', 'cdb378a8-62fd-4db6-bfd6-0804afbff5ba', '0828854a-74c3-4930-b29f-cd04fc30c12f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:40 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:16:40 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:41 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.264s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Deleted volume successfully. Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6d1401b9-fde0-4887-be89-0e340fcb5070 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-8078d385-3d9d-4e27-84c2-0bf09c5887cb-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-e3adc801-3bcb-4e21-9989-d9aeba905553-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-e3adc801-3bcb-4e21-9989-d9aeba905553-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "cinder-quobyte-e3adc801-3bcb-4e21-9989-d9aeba905553" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-e3adc801-3bcb-4e21-9989-d9aeba905553" acquired by "delete_volume" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae3188c-7e0b-4018-bf9f-5ba6f806bc99]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:41 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 Sep 11 23:16:41 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:41 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553" returned: 0 in 0.360s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:41 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553 Sep 11 23:16:41 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:41 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-e3adc801-3bcb-4e21-9989-d9aeba905553" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-quobyte-e3adc801-3bcb-4e21-9989-d9aeba905553" released by "delete_volume" :: held 0.645s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:41 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Created reservations ['235954cc-576d-4e17-819b-fef8fcb2b515', 'dcdebc07-0f59-4e93-8243-690e5dd6755f', 'c43a4933-baa6-4f72-8b60-23bfc64c5022', '7bb545be-366e-44b6-8955-c644156365d0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:42 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:16:42 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:42 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.252s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:42 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Deleted volume successfully. Sep 11 23:16:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-93077a26-d6ef-40f9-a9dc-782e088680c5 tempest-CinderUnicodeTest-1119584177 None] Lock "cinder-e3adc801-3bcb-4e21-9989-d9aeba905553-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Flow 'volume_create_manager' (5df73e4b-f5d7-46d0-b77e-c42791cc362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98c65db-39ab-488d-8ef0-478df8e9f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98c65db-39ab-488d-8ef0-478df8e9f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-126634806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa293c32-e938-403d-a41c-4745af4bef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad806f14195b46139badf82447003ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:47Z,use_quota=True,user_id='41ae0603f84b4052be13f29c21b400bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd82429d-e8dd-46d8-a47e-8e9280ee8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd82429d-e8dd-46d8-a47e-8e9280ee8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fae3651-9266-4bb7-bfcb-87eaef3d282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fae3651-9266-4bb7-bfcb-87eaef3d282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa293c32-e938-403d-a41c-4745af4bef80', 'volume_name': 'volume-aa293c32-e938-403d-a41c-4745af4bef80', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0885e42-5f5d-494f-a1a9-e216bb4ecd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0885e42-5f5d-494f-a1a9-e216bb4ecd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff4928-6a40-4b98-9839-e2e69a75e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Volume aa293c32-e938-403d-a41c-4745af4bef80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa293c32-e938-403d-a41c-4745af4bef80', 'volume_size': 1} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-126634806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa293c32-e938-403d-a41c-4745af4bef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad806f14195b46139badf82447003ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:47Z,use_quota=True,user_id='41ae0603f84b4052be13f29c21b400bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Creating volume aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:47 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:47 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 1073741824 Sep 11 23:16:47 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:47 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 1073741824" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:47 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 Sep 11 23:16:47 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:47 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80" returned: 0 in 0.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff4928-6a40-4b98-9839-e2e69a75e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa293c32-e938-403d-a41c-4745af4bef80', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dc842c-da93-45e4-81ba-8a38d9f3775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Volume volume-aa293c32-e938-403d-a41c-4745af4bef80 (aa293c32-e938-403d-a41c-4745af4bef80): created successfully Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dc842c-da93-45e4-81ba-8a38d9f3775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Flow 'volume_create_manager' (5df73e4b-f5d7-46d0-b77e-c42791cc362f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3d285891-84e4-455d-a275-5c35f1301e6f tempest-VolumeDependencyTests-698897949 None] Created volume successfully. Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Creating offline snapshot acc2859d-40f7-433d-b294-66b9c6a43b7d of volume aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0220338-5732-4118-b952-e91e6b4f80fd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:48 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 Sep 11 23:16:48 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:48 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80" returned: 0 in 0.331s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:48 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d 1G Sep 11 23:16:48 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d 1G" returned: 0 in 0.374s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa293c32-e938-403d-a41c-4745af4bef80 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa293c32-e938-403d-a41c-4745af4bef80 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d Sep 11 23:16:49 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa293c32-e938-403d-a41c-4745af4bef80 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d is being set with open permissions: ugo+rw Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d Sep 11 23:16:49 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info Sep 11 23:16:49 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info" returned: 0 in 0.245s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info is being set with open permissions: ugo+rw Sep 11 23:16:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info Sep 11 23:16:49 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:50 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.info" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:50 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d09cc362-8e23-4edc-ac48-e0d5570eaf12 tempest-VolumeDependencyTests-698897949 None] Create snapshot completed successfully Sep 11 23:16:50 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Flow 'volume_create_manager' (2468934c-bc6f-4c6a-bfa7-6ca4d1e25444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e3a558-91d8-4b0b-9174-87f6abd54bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e3a558-91d8-4b0b-9174-87f6abd54bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-13498273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b73e77-1093-42fd-8d9d-ff28f5263ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad806f14195b46139badf82447003ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=acc2859d-40f7-433d-b294-66b9c6a43b7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:51Z,use_quota=True,user_id='41ae0603f84b4052be13f29c21b400bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57769dac-5d64-4150-87ff-717afca6e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57769dac-5d64-4150-87ff-717afca6e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d123e5f-1abc-4ef4-9230-55f1dd677b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d123e5f-1abc-4ef4-9230-55f1dd677b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68b73e77-1093-42fd-8d9d-ff28f5263ca8', 'volume_name': 'volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8', 'volume_size': 1, 'snapshot_id': 'acc2859d-40f7-433d-b294-66b9c6a43b7d'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e78b93-4722-42ae-8a32-2820c147e9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e78b93-4722-42ae-8a32-2820c147e9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff12efb8-e25f-492a-a942-2d901a3a24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Volume 68b73e77-1093-42fd-8d9d-ff28f5263ca8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8', 'volume_size': 1, 'snapshot_id': 'acc2859d-40f7-433d-b294-66b9c6a43b7d'} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-quobyte-acc2859d-40f7-433d-b294-66b9c6a43b7d-68b73e77-1093-42fd-8d9d-ff28f5263ca8" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-acc2859d-40f7-433d-b294-66b9c6a43b7d-68b73e77-1093-42fd-8d9d-ff28f5263ca8" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Creating volume 68b73e77-1093-42fd-8d9d-ff28f5263ca8 from snapshot acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-quobyte-68b73e77-1093-42fd-8d9d-ff28f5263ca8" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-68b73e77-1093-42fd-8d9d-ff28f5263ca8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] snapshot: acc2859d-40f7-433d-b294-66b9c6a43b7d, volume: 68b73e77-1093-42fd-8d9d-ff28f5263ca8, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1624d-104e-4d96-95c3-469e28d2421b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:51 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d Sep 11 23:16:51 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:51 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d" returned: 0 in 0.358s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa293c32-e938-403d-a41c-4745af4bef80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[609afe2d-e3dc-4d29-9bdf-f39f05da8ab6]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:51 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 Sep 11 23:16:51 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:51 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:16:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:51 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 Sep 11 23:16:51 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:55 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8" returned: 0 in 3.803s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80, size 1024.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:16:55 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Converted 1024.00 MB image at 269.19 MB/s Sep 11 23:16:55 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 is being set with open permissions: ugo+rw Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:55 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 Sep 11 23:16:55 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:55 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8" returned: 0 in 0.227s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-68b73e77-1093-42fd-8d9d-ff28f5263ca8" released by "_copy_volume_from_snapshot" :: held 4.807s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-acc2859d-40f7-433d-b294-66b9c6a43b7d-68b73e77-1093-42fd-8d9d-ff28f5263ca8" released by "_create_volume_from_snapshot" :: held 4.863s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.877s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff12efb8-e25f-492a-a942-2d901a3a24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8', 'volume_size': 1, 'snapshot_id': 'acc2859d-40f7-433d-b294-66b9c6a43b7d'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6dfee-9402-4e85-afa0-d3c83deb6a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Volume volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 (68b73e77-1093-42fd-8d9d-ff28f5263ca8): created successfully Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6dfee-9402-4e85-afa0-d3c83deb6a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Flow 'volume_create_manager' (2468934c-bc6f-4c6a-bfa7-6ca4d1e25444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-09bb2530-f83d-4c10-931a-86f2fccbaaea tempest-VolumeDependencyTests-698897949 None] Created volume successfully. Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-acc2859d-40f7-433d-b294-66b9c6a43b7d-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-acc2859d-40f7-433d-b294-66b9c6a43b7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-quobyte-aa293c32-e938-403d-a41c-4745af4bef80" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-aa293c32-e938-403d-a41c-4745af4bef80" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-quobyte-acc2859d-40f7-433d-b294-66b9c6a43b7d" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-acc2859d-40f7-433d-b294-66b9c6a43b7d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Deleting offline snapshot acc2859d-40f7-433d-b294-66b9c6a43b7d of volume aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] snapshot_file for this snap is: volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ab36d-d5fe-46b0-8a86-dfa8973bffa1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:56 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d Sep 11 23:16:56 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:56 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa293c32-e938-403d-a41c-4745af4bef80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[da75ea4d-ff3d-4122-9dea-b9bc04c119f0]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:56 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 Sep 11 23:16:56 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:57 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80" returned: 0 in 0.494s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:57 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d Sep 11 23:16:57 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:57 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d" returned: 0 in 0.304s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:57 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d Sep 11 23:16:57 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:57 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80.acc2859d-40f7-433d-b294-66b9c6a43b7d" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-acc2859d-40f7-433d-b294-66b9c6a43b7d" released by "_delete_snapshot" :: held 1.472s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-aa293c32-e938-403d-a41c-4745af4bef80" released by "delete_snapshot" :: held 1.495s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:57 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Created reservations ['db739bd3-37d9-4b2a-a0e7-0c03eb0f62ef', '3d02a83c-53aa-47a4-a081-5a6ee10eeb05', 'cf9716db-df99-4906-a772-c7e816b4ab30', 'd47cbce1-6289-4d21-80b4-a98e12f8b744'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Delete snapshot completed successfully. Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-71307536-d9f2-405b-87f6-6e4503b938c0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-acc2859d-40f7-433d-b294-66b9c6a43b7d-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-aa293c32-e938-403d-a41c-4745af4bef80-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-aa293c32-e938-403d-a41c-4745af4bef80-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-quobyte-aa293c32-e938-403d-a41c-4745af4bef80" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-aa293c32-e938-403d-a41c-4745af4bef80" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56a7134-ef7f-4db9-b5c8-5a16c571a2c8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:58 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 Sep 11 23:16:58 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:58 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80" returned: 0 in 0.360s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:59 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80 Sep 11 23:16:59 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:16:59 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-aa293c32-e938-403d-a41c-4745af4bef80" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-aa293c32-e938-403d-a41c-4745af4bef80" released by "delete_volume" :: held 0.652s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Created reservations ['07cbcad1-8dc7-4063-abb8-d26615bb22fe', 'eb2e567f-fcb7-4b18-8a46-cab827c0a3ea', '8673b0cc-d186-472c-bf40-50d67ba074d1', '97a8d46e-caae-433b-8f82-82d7f2556330'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:59 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:16:59 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:59 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Deleted volume successfully. Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c357d77c-ecfe-45dc-aa60-50e1a7983d90 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-aa293c32-e938-403d-a41c-4745af4bef80-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-68b73e77-1093-42fd-8d9d-ff28f5263ca8-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-68b73e77-1093-42fd-8d9d-ff28f5263ca8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "cinder-quobyte-68b73e77-1093-42fd-8d9d-ff28f5263ca8" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-68b73e77-1093-42fd-8d9d-ff28f5263ca8" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c699dfaf-0566-4748-89ec-cd91a73dc62f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:59 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 Sep 11 23:16:59 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:00 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:00 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8 Sep 11 23:17:00 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:00 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-68b73e77-1093-42fd-8d9d-ff28f5263ca8" returned: 0 in 0.232s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-quobyte-68b73e77-1093-42fd-8d9d-ff28f5263ca8" released by "delete_volume" :: held 0.641s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Created reservations ['71edb665-242f-4dac-9007-7d02694d8204', '71bd2188-4395-4240-87c7-e11594632cf1', '9216af5b-49bd-452a-8c1f-7b9c53077f32', 'e945b040-847e-464a-99b8-ba52ee3ca50b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:00 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:17:00 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:00 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.227s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Deleted volume successfully. Sep 11 23:17:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d97928fe-b330-477d-8a94-e9ff10f9e8a0 tempest-VolumeDependencyTests-698897949 None] Lock "cinder-68b73e77-1093-42fd-8d9d-ff28f5263ca8-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:10 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=53,cinder:UPDATE=68,cinder:INSERT=19,cinder:DELETE=4 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:17:10 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=52,cinder:UPDATE=65,cinder:DELETE=7,cinder:INSERT=15 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Flow 'volume_create_manager' (0aef6052-659b-4e4b-94b2-54d7bf36a46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f778ef-4b29-4b21-a1d2-f7a3a08c77e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f778ef-4b29-4b21-a1d2-f7a3a08c77e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-443396037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6458f0fd-4d23-4b59-8dad-bb9a934626ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a9b0b4351449cda4698866bccf0182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:23Z,use_quota=True,user_id='f1848cf20ccf44c8ac88c5980c027d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e6ebe8-7b37-46ac-a4f0-97a5c475e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e6ebe8-7b37-46ac-a4f0-97a5c475e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f761037-9080-47f9-80fd-cc06d915a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f761037-9080-47f9-80fd-cc06d915a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6458f0fd-4d23-4b59-8dad-bb9a934626ec', 'volume_name': 'volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a2b980-1f3b-4290-a0a4-053159496c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a2b980-1f3b-4290-a0a4-053159496c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8792a1e4-dc44-4fb5-8b29-6702c90e3eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Volume 6458f0fd-4d23-4b59-8dad-bb9a934626ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec', 'volume_size': 1} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-443396037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6458f0fd-4d23-4b59-8dad-bb9a934626ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a9b0b4351449cda4698866bccf0182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:23Z,use_quota=True,user_id='f1848cf20ccf44c8ac88c5980c027d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Creating volume 6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:23 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:23 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec 1073741824 Sep 11 23:17:23 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:23 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec 1073741824" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:23 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec Sep 11 23:17:23 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:23 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8792a1e4-dc44-4fb5-8b29-6702c90e3eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a084948-c50c-4a18-993b-5d8d47ec5365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Volume volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec (6458f0fd-4d23-4b59-8dad-bb9a934626ec): created successfully Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a084948-c50c-4a18-993b-5d8d47ec5365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Flow 'volume_create_manager' (0aef6052-659b-4e4b-94b2-54d7bf36a46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-70b8fbbb-964c-48b6-9ea2-acd10ca88e1e tempest-SnapshotDependencyTests-832736054 None] Created volume successfully. Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Creating offline snapshot ea849045-de57-4766-83fb-fa4efc1a27f8 of volume 6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d14d425-9740-4247-8412-2aca9e1e5bce]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:24 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec Sep 11 23:17:24 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:24 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:24 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 1G Sep 11 23:17:24 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:24 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 1G" returned: 0 in 0.359s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:25 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 Sep 11 23:17:25 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:25 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8" returned: 0 in 0.264s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:25 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 is being set with open permissions: ugo+rw Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:25 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 Sep 11 23:17:25 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:25 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8" returned: 0 in 0.221s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:25 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info Sep 11 23:17:25 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:25 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info" returned: 0 in 0.230s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:25 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info is being set with open permissions: ugo+rw Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:25 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info Sep 11 23:17:25 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:25 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.info" returned: 0 in 0.226s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.710s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:26 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c867f258-a785-4b6e-9fa3-66985c83c28e tempest-SnapshotDependencyTests-832736054 None] Create snapshot completed successfully Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Flow 'volume_create_manager' (4a56b0d7-467f-459b-ac04-0ea07d7cfc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe5e5e1-1558-43da-b30b-5f91b7ab7058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe5e5e1-1558-43da-b30b-5f91b7ab7058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f37ebd-a4bd-46e0-900c-0af43b387b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a9b0b4351449cda4698866bccf0182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea849045-de57-4766-83fb-fa4efc1a27f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:27Z,use_quota=True,user_id='f1848cf20ccf44c8ac88c5980c027d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99db355-24d0-4ce6-89f6-010637081822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99db355-24d0-4ce6-89f6-010637081822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11f9127-ae87-41f0-9388-98d75c84ff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11f9127-ae87-41f0-9388-98d75c84ff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45f37ebd-a4bd-46e0-900c-0af43b387b66', 'volume_name': 'volume-45f37ebd-a4bd-46e0-900c-0af43b387b66', 'volume_size': 1, 'snapshot_id': 'ea849045-de57-4766-83fb-fa4efc1a27f8'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e987249a-ef12-4923-9fbb-19777a0b6b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e987249a-ef12-4923-9fbb-19777a0b6b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19def6a3-6d95-4a0b-a4e9-81a0ba825127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:26 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Volume 45f37ebd-a4bd-46e0-900c-0af43b387b66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45f37ebd-a4bd-46e0-900c-0af43b387b66', 'volume_size': 1, 'snapshot_id': 'ea849045-de57-4766-83fb-fa4efc1a27f8'} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-quobyte-ea849045-de57-4766-83fb-fa4efc1a27f8-45f37ebd-a4bd-46e0-900c-0af43b387b66" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-ea849045-de57-4766-83fb-fa4efc1a27f8-45f37ebd-a4bd-46e0-900c-0af43b387b66" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Creating volume 45f37ebd-a4bd-46e0-900c-0af43b387b66 from snapshot ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-quobyte-45f37ebd-a4bd-46e0-900c-0af43b387b66" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-45f37ebd-a4bd-46e0-900c-0af43b387b66" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] snapshot: ea849045-de57-4766-83fb-fa4efc1a27f8, volume: 45f37ebd-a4bd-46e0-900c-0af43b387b66, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc8a690-f006-49da-bc90-b1e0b42e787c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:27 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 Sep 11 23:17:27 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:27 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8" returned: 0 in 0.336s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a5a52-d1a0-4da3-9ddb-6ad55c19a1cf]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:27 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec Sep 11 23:17:27 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:27 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec" returned: 0 in 0.329s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:17:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:27 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 Sep 11 23:17:27 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:31 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66" returned: 0 in 3.670s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec, size 1024.00 MB, duration 3.67 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:17:31 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Converted 1024.00 MB image at 278.92 MB/s Sep 11 23:17:31 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 is being set with open permissions: ugo+rw Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:31 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 Sep 11 23:17:31 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:31 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66" returned: 0 in 0.228s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-45f37ebd-a4bd-46e0-900c-0af43b387b66" released by "_copy_volume_from_snapshot" :: held 4.633s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-ea849045-de57-4766-83fb-fa4efc1a27f8-45f37ebd-a4bd-46e0-900c-0af43b387b66" released by "_create_volume_from_snapshot" :: held 4.688s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.703s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19def6a3-6d95-4a0b-a4e9-81a0ba825127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f37ebd-a4bd-46e0-900c-0af43b387b66', 'volume_size': 1, 'snapshot_id': 'ea849045-de57-4766-83fb-fa4efc1a27f8'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189f5ab8-c5d0-4e76-8dd4-35d8c7c16614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:31 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Volume volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 (45f37ebd-a4bd-46e0-900c-0af43b387b66): created successfully Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189f5ab8-c5d0-4e76-8dd4-35d8c7c16614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:31 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Flow 'volume_create_manager' (4a56b0d7-467f-459b-ac04-0ea07d7cfc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3f202eef-b97b-44a7-ade0-eb982c04c7b7 tempest-SnapshotDependencyTests-832736054 None] Created volume successfully. Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-ea849045-de57-4766-83fb-fa4efc1a27f8-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-ea849045-de57-4766-83fb-fa4efc1a27f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-quobyte-6458f0fd-4d23-4b59-8dad-bb9a934626ec" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-6458f0fd-4d23-4b59-8dad-bb9a934626ec" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-quobyte-ea849045-de57-4766-83fb-fa4efc1a27f8" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-ea849045-de57-4766-83fb-fa4efc1a27f8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Deleting offline snapshot ea849045-de57-4766-83fb-fa4efc1a27f8 of volume 6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] snapshot_file for this snap is: volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2eecbe-2c87-4282-8e31-27f39aaf51ce]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:32 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 Sep 11 23:17:32 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:32 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be8c6db-9cbd-4e78-a2bb-b4162e49f521]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:32 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec Sep 11 23:17:32 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:33 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec" returned: 0 in 0.492s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:33 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 Sep 11 23:17:33 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:33 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8" returned: 0 in 0.311s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:33 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8 Sep 11 23:17:33 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:33 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec.ea849045-de57-4766-83fb-fa4efc1a27f8" returned: 0 in 0.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-ea849045-de57-4766-83fb-fa4efc1a27f8" released by "_delete_snapshot" :: held 1.460s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-6458f0fd-4d23-4b59-8dad-bb9a934626ec" released by "delete_snapshot" :: held 1.481s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:33 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Created reservations ['3f862d5e-d2ed-4455-bcb9-212e75195337', '23a287dd-7636-42db-b051-36c4a140dba4', '4aa55f66-4bbc-4a0d-9a79-9c949b249fe2', '33ac89c3-bf5a-439a-b80a-0c0678333a35'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Delete snapshot completed successfully. Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ff1d9e7f-1639-4d20-b16c-ad106c214a9b tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-ea849045-de57-4766-83fb-fa4efc1a27f8-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-6458f0fd-4d23-4b59-8dad-bb9a934626ec-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-6458f0fd-4d23-4b59-8dad-bb9a934626ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-quobyte-6458f0fd-4d23-4b59-8dad-bb9a934626ec" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-6458f0fd-4d23-4b59-8dad-bb9a934626ec" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[36099ede-5508-441b-bfc4-23f5790c2ef0]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:34 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec Sep 11 23:17:34 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:34 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:34 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec Sep 11 23:17:34 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:35 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6458f0fd-4d23-4b59-8dad-bb9a934626ec" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-6458f0fd-4d23-4b59-8dad-bb9a934626ec" released by "delete_volume" :: held 0.616s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Created reservations ['b6b1718c-572e-4ea3-99bd-2ed3a0ac2eda', '0e5f117f-addf-4cb2-95d3-23a67bbe6016', '148a3bbf-1170-4927-ab92-e0a608b7c1a3', '7867143c-fb30-4bc1-914d-2fb9494619d3'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:35 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:17:35 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:35 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Deleted volume successfully. Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0f8f7e18-4377-4c53-896d-1d350596f3e1 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-6458f0fd-4d23-4b59-8dad-bb9a934626ec-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-45f37ebd-a4bd-46e0-900c-0af43b387b66-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-45f37ebd-a4bd-46e0-900c-0af43b387b66-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "cinder-quobyte-45f37ebd-a4bd-46e0-900c-0af43b387b66" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-45f37ebd-a4bd-46e0-900c-0af43b387b66" acquired by "delete_volume" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c5e6f-ae61-4fd4-aa42-73793d1e7f30]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:35 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 Sep 11 23:17:35 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:36 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66" returned: 0 in 0.336s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:36 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66 Sep 11 23:17:36 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:36 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-45f37ebd-a4bd-46e0-900c-0af43b387b66" returned: 0 in 0.226s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-quobyte-45f37ebd-a4bd-46e0-900c-0af43b387b66" released by "delete_volume" :: held 0.597s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Created reservations ['29817a2f-374b-470b-9241-9caacb4219a5', '9830918d-8562-4049-8899-3b628d0ca925', 'c8544e68-38af-4089-938f-d992d95cc371', '7df16a59-3414-4960-bc7c-6de3df27cf50'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:36 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:17:36 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:36 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.222s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Deleted volume successfully. Sep 11 23:17:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-256394f1-bcca-4d85-a977-93727d5853c3 tempest-SnapshotDependencyTests-832736054 None] Lock "cinder-45f37ebd-a4bd-46e0-900c-0af43b387b66-delete_volume" released by "delete_volume" :: held 0.995s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:46 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=27,cinder:UPDATE=26,cinder:INSERT=10,cinder:DELETE=2 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:17:46 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=3,cinder:SELECT=22 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (7e049c6f-6c56-408b-97db-6a6fd75b4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7b60c1-bea1-4641-90a8-d90020ae96ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7b60c1-bea1-4641-90a8-d90020ae96ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1642362807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da5814c-53e9-4e72-8614-b565d93dbdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:56Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a836e9-11eb-43c0-9d7f-d4b63003ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a836e9-11eb-43c0-9d7f-d4b63003ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7146519-93c8-4f76-95aa-d597cd1f483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7146519-93c8-4f76-95aa-d597cd1f483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da5814c-53e9-4e72-8614-b565d93dbdcf', 'volume_name': 'volume-1da5814c-53e9-4e72-8614-b565d93dbdcf', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e017b3ba-9bec-4ed5-8d90-ddac306d19ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e017b3ba-9bec-4ed5-8d90-ddac306d19ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73746379-4611-4478-85a1-87f453254574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume 1da5814c-53e9-4e72-8614-b565d93dbdcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da5814c-53e9-4e72-8614-b565d93dbdcf', 'volume_size': 1} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1642362807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da5814c-53e9-4e72-8614-b565d93dbdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:56Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Creating volume 1da5814c-53e9-4e72-8614-b565d93dbdcf {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:56 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:56 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf 1073741824 Sep 11 23:17:56 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (fc74ba46-f9c5-4737-9160-0f0df1e86422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae47c46-ebe8-4e6e-8f62-fef52289fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae47c46-ebe8-4e6e-8f62-fef52289fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-809885609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cf2e6a-5517-46cf-aea2-6c262321a6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:57Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aa45d1-5b2c-4824-9d1c-bc84ca5c6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aa45d1-5b2c-4824-9d1c-bc84ca5c6e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cbb082-3dbc-4c40-a28e-bb4c1ecced81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cbb082-3dbc-4c40-a28e-bb4c1ecced81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85cf2e6a-5517-46cf-aea2-6c262321a6df', 'volume_name': 'volume-85cf2e6a-5517-46cf-aea2-6c262321a6df', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e3eebd-eaa5-4023-984e-b980ac6ce718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e3eebd-eaa5-4023-984e-b980ac6ce718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60ef1dd-b0d0-471e-8c30-ba9afd442cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:56 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Volume 85cf2e6a-5517-46cf-aea2-6c262321a6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85cf2e6a-5517-46cf-aea2-6c262321a6df', 'volume_size': 1} Sep 11 23:17:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:57 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (5d904b62-e792-4d5e-a502-c3ef34ae310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da02377-de9f-4a3c-a76b-e3e2f22cb4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf 1073741824" returned: 0 in 0.682s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da02377-de9f-4a3c-a76b-e3e2f22cb4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2147291897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005b67d7-eb5e-457d-b2f3-16aef117d0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:57Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18aeaff6-eb7f-470b-8cc4-7d35eddf0e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18aeaff6-eb7f-470b-8cc4-7d35eddf0e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4206b8-caa1-44ed-b6c9-de5559d5332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4206b8-caa1-44ed-b6c9-de5559d5332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005b67d7-eb5e-457d-b2f3-16aef117d0e1', 'volume_name': 'volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533caa81-61b4-4935-b4f7-a5966c31b641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533caa81-61b4-4935-b4f7-a5966c31b641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0624ced9-8298-43c0-be98-b47de1c02df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Volume 005b67d7-eb5e-457d-b2f3-16aef117d0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1', 'volume_size': 1} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:57 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf Sep 11 23:17:57 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:57 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-809885609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cf2e6a-5517-46cf-aea2-6c262321a6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:57Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Creating volume 85cf2e6a-5517-46cf-aea2-6c262321a6df {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:57 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:57 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df 1073741824 Sep 11 23:17:57 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73746379-4611-4478-85a1-87f453254574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da5814c-53e9-4e72-8614-b565d93dbdcf', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bc5af6-9f6b-4ba8-9753-fe9421262ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume volume-1da5814c-53e9-4e72-8614-b565d93dbdcf (1da5814c-53e9-4e72-8614-b565d93dbdcf): created successfully Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bc5af6-9f6b-4ba8-9753-fe9421262ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (7e049c6f-6c56-408b-97db-6a6fd75b4841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (3eb54bfd-58c2-4044-8f5f-ec81f4895d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fff7926-8e5b-4315-ac63-0e0aedd03e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fff7926-8e5b-4315-ac63-0e0aedd03e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237264383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f152a14-b8ca-46e9-a36f-1e10336cd681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:58Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae7271f-e6ce-4a2d-8048-2caeeac981d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae7271f-e6ce-4a2d-8048-2caeeac981d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352400f0-fa17-43f8-9bb9-06e8e7e8c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352400f0-fa17-43f8-9bb9-06e8e7e8c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f152a14-b8ca-46e9-a36f-1e10336cd681', 'volume_name': 'volume-9f152a14-b8ca-46e9-a36f-1e10336cd681', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a096ba20-b57e-468e-812e-48d404e63bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a096ba20-b57e-468e-812e-48d404e63bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45603d75-2850-4ca6-b796-1c5f092c3611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume 9f152a14-b8ca-46e9-a36f-1e10336cd681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f152a14-b8ca-46e9-a36f-1e10336cd681', 'volume_size': 1} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1f01e916-c346-4aae-86f8-9475f43fda20 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created volume successfully. Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (7f7aea8e-4c9f-48e2-9ad5-7eb35705b8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f3a0a5-c28e-4e13-909b-50c7f7a713c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f3a0a5-c28e-4e13-909b-50c7f7a713c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097280789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1230d97f-a18f-4093-bd99-2d616644ce0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:58Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d484f1-4d06-4254-9bd4-57776c45c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d484f1-4d06-4254-9bd4-57776c45c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e99d413-545e-43f4-9b62-7e0ebdf01632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e99d413-545e-43f4-9b62-7e0ebdf01632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1230d97f-a18f-4093-bd99-2d616644ce0b', 'volume_name': 'volume-1230d97f-a18f-4093-bd99-2d616644ce0b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6aafe3-4de1-4b1a-9fea-406dad60f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6aafe3-4de1-4b1a-9fea-406dad60f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd3a790-b997-4781-90b0-82090e58866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Volume 1230d97f-a18f-4093-bd99-2d616644ce0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1230d97f-a18f-4093-bd99-2d616644ce0b', 'volume_size': 1} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:58 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (eaa73a6c-faf8-4ad4-912e-14c36aed6d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2064ccf1-7568-4517-837f-c046c4392698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df 1073741824" returned: 0 in 0.693s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2064ccf1-7568-4517-837f-c046c4392698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500391278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da33c990-5f57-47c3-8f9f-b235baa3205f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:58Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eab2a9b-d03f-4f1e-bd96-8dd746a96ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eab2a9b-d03f-4f1e-bd96-8dd746a96ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94788801-f9fb-4178-a873-cd78eab5e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94788801-f9fb-4178-a873-cd78eab5e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da33c990-5f57-47c3-8f9f-b235baa3205f', 'volume_name': 'volume-da33c990-5f57-47c3-8f9f-b235baa3205f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34801ea-748a-4ab6-8c64-fc26d7ed5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34801ea-748a-4ab6-8c64-fc26d7ed5281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca551215-6fdf-45b0-9041-7b1ddaa3da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Volume da33c990-5f57-47c3-8f9f-b235baa3205f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da33c990-5f57-47c3-8f9f-b235baa3205f', 'volume_size': 1} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:58 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df Sep 11 23:17:58 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:58 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2147291897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005b67d7-eb5e-457d-b2f3-16aef117d0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:57Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Creating volume 005b67d7-eb5e-457d-b2f3-16aef117d0e1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:58 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:58 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 1073741824 Sep 11 23:17:58 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60ef1dd-b0d0-471e-8c30-ba9afd442cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cf2e6a-5517-46cf-aea2-6c262321a6df', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b3557b-fbe4-47a8-ad90-62c586e239da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (8094d684-a917-4074-80e1-10e0f17a9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44daebc-c65c-4fcd-8490-58a788f0b8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Volume volume-85cf2e6a-5517-46cf-aea2-6c262321a6df (85cf2e6a-5517-46cf-aea2-6c262321a6df): created successfully Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b3557b-fbe4-47a8-ad90-62c586e239da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (fc74ba46-f9c5-4737-9160-0f0df1e86422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44daebc-c65c-4fcd-8490-58a788f0b8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1589217359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602f31c3-3fa1-4227-b3e0-da192364e77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:59Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9066224e-0fe8-41b4-8d17-7c2e094fe6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9066224e-0fe8-41b4-8d17-7c2e094fe6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99c97ee-2fd9-44b5-9b85-c504a667960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99c97ee-2fd9-44b5-9b85-c504a667960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602f31c3-3fa1-4227-b3e0-da192364e77b', 'volume_name': 'volume-602f31c3-3fa1-4227-b3e0-da192364e77b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4d0136-2ffe-4bae-93de-919ed8300baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4d0136-2ffe-4bae-93de-919ed8300baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca69ddb3-f02e-458d-8b0c-c6ceb4e32394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Volume 602f31c3-3fa1-4227-b3e0-da192364e77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602f31c3-3fa1-4227-b3e0-da192364e77b', 'volume_size': 1} Sep 11 23:17:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-874263ae-04fb-471e-8e03-17b3ae1132ac tempest-CreateVolumesFromImageTest-470762212 None] Created volume successfully. Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:59 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:17:59 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (72dfd866-258d-42a2-8deb-2374e1849769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cc2efd-ad9b-432c-833f-88f6f82e1a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cc2efd-ad9b-432c-833f-88f6f82e1a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1180669606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57da93df-1de9-43bb-b807-e961f8f97730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:59Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ed02e2-6b97-4c90-88df-431414a43ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ed02e2-6b97-4c90-88df-431414a43ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0de64a-1d26-404b-9136-549b9c95b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0de64a-1d26-404b-9136-549b9c95b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57da93df-1de9-43bb-b807-e961f8f97730', 'volume_name': 'volume-57da93df-1de9-43bb-b807-e961f8f97730', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5b19ea-924a-4bb3-9a98-ab59211c0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5b19ea-924a-4bb3-9a98-ab59211c0052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c71319f-f223-4110-b186-0ca4b5cc6395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume 57da93df-1de9-43bb-b807-e961f8f97730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57da93df-1de9-43bb-b807-e961f8f97730', 'volume_size': 1} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 1073741824" returned: 0 in 0.600s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:59 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 Sep 11 23:17:59 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:59 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.415s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:17:59 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1" returned: 0 in 0.360s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237264383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f152a14-b8ca-46e9-a36f-1e10336cd681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:58Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating volume 9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:59 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:59 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 1073741824 Sep 11 23:17:59 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0624ced9-8298-43c0-be98-b47de1c02df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc351815-c45c-4de7-9853-a20bb92c83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (ee08a83d-beb1-4ae2-891b-8fa55b853bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6463c2-2590-493a-b740-89991a096a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:59 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Volume volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 (005b67d7-eb5e-457d-b2f3-16aef117d0e1): created successfully Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc351815-c45c-4de7-9853-a20bb92c83a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (5d904b62-e792-4d5e-a502-c3ef34ae310e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6463c2-2590-493a-b740-89991a096a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1551581937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1dd55f-5d5a-451c-82dc-8637a2504218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:00Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddfa6be-1970-4be0-9700-385c93b6c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddfa6be-1970-4be0-9700-385c93b6c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53351d7c-964f-4891-b7ec-9819bba15725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53351d7c-964f-4891-b7ec-9819bba15725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1dd55f-5d5a-451c-82dc-8637a2504218', 'volume_name': 'volume-db1dd55f-5d5a-451c-82dc-8637a2504218', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d37645-c262-4279-995f-cef074bd33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d37645-c262-4279-995f-cef074bd33e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e47725-1b91-4ac6-83d9-9bd9b19d6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume db1dd55f-5d5a-451c-82dc-8637a2504218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1dd55f-5d5a-451c-82dc-8637a2504218', 'volume_size': 1} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-20c01c6a-bdd4-43f0-a278-fb1938a18d81 tempest-CreateVolumesFromImageTest-470762212 None] Created volume successfully. Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (5f34d5e9-550c-477b-8c1b-12cd5e511953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e80ae6-7ddc-425c-bbbc-f8b29ed76b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e80ae6-7ddc-425c-bbbc-f8b29ed76b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194864292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f30d2d-67d6-4b00-81ee-5d296179b7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:00Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e011856-ce63-4b83-8cd5-0759101c1c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e011856-ce63-4b83-8cd5-0759101c1c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb3a79c-0940-4392-8674-081bd5e1c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb3a79c-0940-4392-8674-081bd5e1c48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f30d2d-67d6-4b00-81ee-5d296179b7c2', 'volume_name': 'volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5643ac-f339-44e5-8f45-e5d01c9d3b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5643ac-f339-44e5-8f45-e5d01c9d3b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bff89f-e8a5-4dd4-9a3f-4a897d78b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume 11f30d2d-67d6-4b00-81ee-5d296179b7c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2', 'volume_size': 1} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 1073741824" returned: 0 in 0.570s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:00 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 Sep 11 23:18:00 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (69ed7397-0660-4f19-ba06-ff2cfa01a912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8855a275-b95a-495f-b01f-44059cfcaacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681" returned: 0 in 0.344s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.704s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097280789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1230d97f-a18f-4093-bd99-2d616644ce0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:58Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Creating volume 1230d97f-a18f-4093-bd99-2d616644ce0b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8855a275-b95a-495f-b01f-44059cfcaacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-487543306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a235f2f9-bf60-4d98-ac8e-4bec2a046495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:01Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfeace1-e679-4f13-a813-f97156922a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b 1073741824 Sep 11 23:18:00 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfeace1-e679-4f13-a813-f97156922a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c142c6d2-9552-4281-bc6e-cca341641dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c142c6d2-9552-4281-bc6e-cca341641dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a235f2f9-bf60-4d98-ac8e-4bec2a046495', 'volume_name': 'volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076b3b90-59fc-44a7-a6dd-23c2673bcb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076b3b90-59fc-44a7-a6dd-23c2673bcb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fa427d-a84e-45cf-aea5-dfc4bb83386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume a235f2f9-bf60-4d98-ac8e-4bec2a046495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495', 'volume_size': 1} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45603d75-2850-4ca6-b796-1c5f092c3611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f152a14-b8ca-46e9-a36f-1e10336cd681', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e256e6-ca8a-47fd-8f88-129164db5b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 (9f152a14-b8ca-46e9-a36f-1e10336cd681): created successfully Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e256e6-ca8a-47fd-8f88-129164db5b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:00 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (3eb54bfd-58c2-4044-8f5f-ec81f4895d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e201878d-a098-42f6-8e17-def3eee20799 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created volume successfully. Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (6555e3fb-17ef-4692-9f1e-0122c1b6528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cca97a1-95c2-4119-a497-777187d004f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cca97a1-95c2-4119-a497-777187d004f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668985921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788dc538-e6f3-4855-b6eb-68dab608fd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:01Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8775d74f-ee97-4497-b254-f5142d130c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8775d74f-ee97-4497-b254-f5142d130c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f26922c-4f07-4554-a435-51a4c6cc4a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f26922c-4f07-4554-a435-51a4c6cc4a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788dc538-e6f3-4855-b6eb-68dab608fd9b', 'volume_name': 'volume-788dc538-e6f3-4855-b6eb-68dab608fd9b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2dd935-32d4-446b-a33e-201990562fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2dd935-32d4-446b-a33e-201990562fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0c245-c6dc-4fc9-8efb-e1b90951ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume 788dc538-e6f3-4855-b6eb-68dab608fd9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788dc538-e6f3-4855-b6eb-68dab608fd9b', 'volume_size': 1} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:01 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b 1073741824" returned: 0 in 0.576s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:01 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b Sep 11 23:18:01 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Flow 'volume_create_manager' (b39e10ce-41ff-4240-a369-256edb2b42a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5956ec-44b0-4c84-be6b-fc721e185787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5956ec-44b0-4c84-be6b-fc721e185787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e64269a-1216-4cdb-b5f6-5e0188555de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827d25aba6c7484fb1928cf920579cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:02Z,use_quota=True,user_id='9daf2093eefd45349e6e435a4a9656c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4965f37f-5ed9-43ca-afbe-a6614a9c52a2),volume_type_id=4965f37f-5ed9-43ca-afbe-a6614a9c52a2)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27671d3-b1d5-43e0-b4bf-00b44956e7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27671d3-b1d5-43e0-b4bf-00b44956e7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644f7540-ce1b-4888-9fbd-4d54f895e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:18:01 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b" returned: 0 in 0.265s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.327s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500391278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da33c990-5f57-47c3-8f9f-b235baa3205f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:58Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Creating volume da33c990-5f57-47c3-8f9f-b235baa3205f {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:01 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd3a790-b997-4781-90b0-82090e58866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1230d97f-a18f-4093-bd99-2d616644ce0b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f 1073741824 Sep 11 23:18:01 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa77ccc4-fad4-4215-84d1-1f3843b53bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:01 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Volume volume-1230d97f-a18f-4093-bd99-2d616644ce0b (1230d97f-a18f-4093-bd99-2d616644ce0b): created successfully Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa77ccc4-fad4-4215-84d1-1f3843b53bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (7f7aea8e-4c9f-48e2-9ad5-7eb35705b8b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fb1f2e18-d12b-4a2c-a14b-eb6611f023c4 tempest-CreateVolumesFromImageTest-470762212 None] Created volume successfully. Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644f7540-ce1b-4888-9fbd-4d54f895e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e64269a-1216-4cdb-b5f6-5e0188555de4', 'volume_name': 'volume-0e64269a-1216-4cdb-b5f6-5e0188555de4', 'volume_size': 1, 'image_id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7c6a8e9-a364-491a-9564-1fb46f587d47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94d697273a2db1505c9474b932634524', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '827d25aba6c7484fb1928cf920579cd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e16ba046c57a608b03f51a7d0c12e79fc0af31f5a84162065fa2175e42dca31c3dfff218c35c7563a27ffb82d4d595804c276690677eee2a3978e1879c958085', 'id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'created_at': datetime.datetime(2026, 9, 11, 21, 17, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7c6a8e9-a364-491a-9564-1fb46f587d47/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2f6959-3c8a-475a-95ec-d89e39174fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2f6959-3c8a-475a-95ec-d89e39174fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f613e6-5aef-4ff2-961a-abb3ac0d20d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Volume 0e64269a-1216-4cdb-b5f6-5e0188555de4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e64269a-1216-4cdb-b5f6-5e0188555de4', 'volume_size': 1, 'image_id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7c6a8e9-a364-491a-9564-1fb46f587d47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94d697273a2db1505c9474b932634524', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '827d25aba6c7484fb1928cf920579cd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e16ba046c57a608b03f51a7d0c12e79fc0af31f5a84162065fa2175e42dca31c3dfff218c35c7563a27ffb82d4d595804c276690677eee2a3978e1879c958085', 'id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'created_at': datetime.datetime(2026, 9, 11, 21, 17, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7c6a8e9-a364-491a-9564-1fb46f587d47/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Trying to clone 0e64269a-1216-4cdb-b5f6-5e0188555de4 from image b7c6a8e9-a364-491a-9564-1fb46f587d47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7c6a8e9-a364-491a-9564-1fb46f587d47', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:18:02 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f156d1d-3a66-4523-b3cd-1f806012b9ac]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:02 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f 1073741824" returned: 0 in 0.650s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:02 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD Sep 11 23:18:02 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:02 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f Sep 11 23:18:02 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:02 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:02 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f" returned: 0 in 0.305s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.762s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1589217359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602f31c3-3fa1-4227-b3e0-da192364e77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82884df0e1475fa1c234f02bcb73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:59Z,use_quota=True,user_id='0d3f603ae5fe4f699d8d80b3604ca0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Creating volume 602f31c3-3fa1-4227-b3e0-da192364e77b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:02 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca551215-6fdf-45b0-9041-7b1ddaa3da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da33c990-5f57-47c3-8f9f-b235baa3205f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:02 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD Sep 11 23:18:02 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c59f1d-3793-48df-8681-6ffcb05c4e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:02 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b 1073741824 Sep 11 23:18:02 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Volume volume-da33c990-5f57-47c3-8f9f-b235baa3205f (da33c990-5f57-47c3-8f9f-b235baa3205f): created successfully Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c59f1d-3793-48df-8681-6ffcb05c4e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (eaa73a6c-faf8-4ad4-912e-14c36aed6d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0ff393ee-3a24-497b-98c3-81ce24417d49 tempest-CreateVolumesFromImageTest-470762212 None] Created volume successfully. Sep 11 23:18:03 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Temporary image b7c6a8e9-a364-491a-9564-1fb46f587d47 is fetched for user 9daf2093eefd45349e6e435a4a9656c2. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ce2ce-465c-416c-80ef-ff7af66c844b]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:03 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD Sep 11 23:18:03 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:03 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b 1073741824" returned: 0 in 0.501s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:03 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b Sep 11 23:18:03 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:03 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:03 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1180669606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57da93df-1de9-43bb-b807-e961f8f97730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:59Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Creating volume 57da93df-1de9-43bb-b807-e961f8f97730 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:03 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:03 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:03 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:03 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 1073741824 Sep 11 23:18:03 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca69ddb3-f02e-458d-8b0c-c6ceb4e32394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602f31c3-3fa1-4227-b3e0-da192364e77b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2290da9-5d58-4ba3-8f75-ed815f8ff2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Volume volume-602f31c3-3fa1-4227-b3e0-da192364e77b (602f31c3-3fa1-4227-b3e0-da192364e77b): created successfully Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2290da9-5d58-4ba3-8f75-ed815f8ff2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Flow 'volume_create_manager' (8094d684-a917-4074-80e1-10e0f17a9208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e9b2d5e2-e8b6-4302-924f-dc3c5192152f tempest-CreateVolumesFromImageTest-470762212 None] Created volume successfully. Sep 11 23:18:03 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:04 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 1073741824" returned: 0 in 0.438s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:04 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 Sep 11 23:18:04 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:04 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.316s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1551581937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1dd55f-5d5a-451c-82dc-8637a2504218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:00Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Creating volume db1dd55f-5d5a-451c-82dc-8637a2504218 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:04 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c71319f-f223-4110-b186-0ca4b5cc6395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57da93df-1de9-43bb-b807-e961f8f97730', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf272e7-d84e-466d-acbf-7bbf4f4e81e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:04 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 1073741824 Sep 11 23:18:04 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:04 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume volume-57da93df-1de9-43bb-b807-e961f8f97730 (57da93df-1de9-43bb-b807-e961f8f97730): created successfully Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf272e7-d84e-466d-acbf-7bbf4f4e81e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (72dfd866-258d-42a2-8deb-2374e1849769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-681f44c9-3441-4778-a93c-312628df9ba4 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created volume successfully. Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-602f31c3-3fa1-4227-b3e0-da192364e77b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-602f31c3-3fa1-4227-b3e0-da192364e77b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-quobyte-602f31c3-3fa1-4227-b3e0-da192364e77b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-602f31c3-3fa1-4227-b3e0-da192364e77b" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650c164-d13d-4a8b-8a78-8399985c082d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:04 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 1073741824" returned: 0 in 0.550s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:04 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b Sep 11 23:18:04 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:04 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 Sep 11 23:18:04 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:05 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b" returned: 0 in 0.378s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:05 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b Sep 11 23:18:05 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:05 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218" returned: 0 in 0.302s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.855s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194864292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f30d2d-67d6-4b00-81ee-5d296179b7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:00Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Creating volume 11f30d2d-67d6-4b00-81ee-5d296179b7c2 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:05 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e47725-1b91-4ac6-83d9-9bd9b19d6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1dd55f-5d5a-451c-82dc-8637a2504218', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c5a43f-6430-427f-85d3-91b32e26d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:05 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 1073741824 Sep 11 23:18:05 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:05 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume volume-db1dd55f-5d5a-451c-82dc-8637a2504218 (db1dd55f-5d5a-451c-82dc-8637a2504218): created successfully Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c5a43f-6430-427f-85d3-91b32e26d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (ee08a83d-beb1-4ae2-891b-8fa55b853bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ebb4f90b-2ec3-42d8-b6b8-4420d20bf466 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created volume successfully. Sep 11 23:18:05 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-602f31c3-3fa1-4227-b3e0-da192364e77b" returned: 0 in 0.269s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-602f31c3-3fa1-4227-b3e0-da192364e77b" released by "delete_volume" :: held 0.695s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Created reservations ['08583275-bfbb-4d8a-a5af-f8271bb84bc3', 'a1a5c2ea-4f89-4ebb-b91c-7fab5f5271a3', '773c18c3-3f06-4bb8-a260-c60c696f213e', '93c4cc6b-a6d8-49be-b520-9271537b5bb0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:05 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:05 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:05 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 1073741824" returned: 0 in 0.491s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:05 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 Sep 11 23:18:05 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:05 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Deleted volume successfully. Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-63e786cd-4e60-4a8c-9344-dfca7873c8fa tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-602f31c3-3fa1-4227-b3e0-da192364e77b-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-da33c990-5f57-47c3-8f9f-b235baa3205f-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-da33c990-5f57-47c3-8f9f-b235baa3205f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-quobyte-da33c990-5f57-47c3-8f9f-b235baa3205f" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-da33c990-5f57-47c3-8f9f-b235baa3205f" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f14daaf-61b1-4f5f-b198-07b20f60f65b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:06 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2" returned: 0 in 0.314s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.249s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-487543306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a235f2f9-bf60-4d98-ac8e-4bec2a046495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:01Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Creating volume a235f2f9-bf60-4d98-ac8e-4bec2a046495 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:06 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:06 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f Sep 11 23:18:06 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bff89f-e8a5-4dd4-9a3f-4a897d78b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24867e90-b530-4bf3-ad60-c8065488131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:06 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 1073741824 Sep 11 23:18:06 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 (11f30d2d-67d6-4b00-81ee-5d296179b7c2): created successfully Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24867e90-b530-4bf3-ad60-c8065488131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (5f34d5e9-550c-477b-8c1b-12cd5e511953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:06 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ea3091ad-0ee2-4033-9e34-51b0c20ccc5d tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created volume successfully. Sep 11 23:18:06 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f" returned: 0 in 0.402s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:06 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f Sep 11 23:18:06 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:06 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 1073741824" returned: 0 in 0.453s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:06 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 Sep 11 23:18:06 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:06 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-da33c990-5f57-47c3-8f9f-b235baa3205f" returned: 0 in 0.272s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-da33c990-5f57-47c3-8f9f-b235baa3205f" released by "delete_volume" :: held 0.716s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Created reservations ['54ebb8ed-f5bf-490d-9b58-090c3d7562ee', '42cf2483-1114-4793-8b64-cfdda57b7789', '1cb202c5-fa88-425a-a2cf-bc6921f9d38a', 'b37204f6-c8c6-4cf4-8701-e648c99313f5'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:06 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:06 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:06 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.625s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668985921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788dc538-e6f3-4855-b6eb-68dab608fd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c571ae2a604dbda35dbcef11e65055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:01Z,use_quota=True,user_id='1a21204de55a43eb9e833b080d68f362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Creating volume 788dc538-e6f3-4855-b6eb-68dab608fd9b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:06 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fa427d-a84e-45cf-aea5-dfc4bb83386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:06 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b 1073741824 Sep 11 23:18:06 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13230af-8af6-4bac-9ba6-524f5219f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:07 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 (a235f2f9-bf60-4d98-ac8e-4bec2a046495): created successfully Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13230af-8af6-4bac-9ba6-524f5219f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (69ed7397-0660-4f19-ba06-ff2cfa01a912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8006aa42-afce-4198-9e39-835b5c12b661 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created volume successfully. Sep 11 23:18:07 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-1230d97f-a18f-4093-bd99-2d616644ce0b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.300s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Deleted volume successfully. Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-1230d97f-a18f-4093-bd99-2d616644ce0b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-deef55ac-6aef-45d7-8f49-d7b371910b67 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-da33c990-5f57-47c3-8f9f-b235baa3205f-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-quobyte-1230d97f-a18f-4093-bd99-2d616644ce0b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-1230d97f-a18f-4093-bd99-2d616644ce0b" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[10683d1f-a267-4bf0-8cea-4f6734b0871a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:07 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b Sep 11 23:18:07 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:07 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b 1073741824" returned: 0 in 0.518s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:07 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b Sep 11 23:18:07 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:07 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b" returned: 0 in 0.387s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:07 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b Sep 11 23:18:07 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:07 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b" returned: 0 in 0.253s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.575s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0c245-c6dc-4fc9-8efb-e1b90951ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788dc538-e6f3-4855-b6eb-68dab608fd9b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16edcdb-e054-4c1a-be99-25b973da888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating offline snapshot 6e4974cf-1044-489b-929e-296b110be3a4 of volume 9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:18:07 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Volume volume-788dc538-e6f3-4855-b6eb-68dab608fd9b (788dc538-e6f3-4855-b6eb-68dab608fd9b): created successfully Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16edcdb-e054-4c1a-be99-25b973da888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Flow 'volume_create_manager' (6555e3fb-17ef-4692-9f1e-0122c1b6528a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef16cbf4-30fb-4bb2-bf3f-001d27143800]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-839c8e0a-4ad3-46b8-83d8-0f5fe7c5c36e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created volume successfully. Sep 11 23:18:07 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 Sep 11 23:18:07 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:07 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1230d97f-a18f-4093-bd99-2d616644ce0b" returned: 0 in 0.278s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-1230d97f-a18f-4093-bd99-2d616644ce0b" released by "delete_volume" :: held 0.717s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Created reservations ['6ca71182-741e-445f-b984-9b3faebbb615', '25d4809b-4873-48ce-8958-93016eb7ebdb', 'f64c13eb-9e24-4f68-8b75-f9eed90b7d6f', 'b72ddd4f-5516-4f34-b543-7b76f31edcb9'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:08 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:08 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:08 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681" returned: 0 in 0.393s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:08 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 1G Sep 11 23:18:08 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:08 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.263s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Deleted volume successfully. Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-005b67d7-eb5e-457d-b2f3-16aef117d0e1-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-005b67d7-eb5e-457d-b2f3-16aef117d0e1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5fec67c1-b897-4b6a-bd20-483db65252c8 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-1230d97f-a18f-4093-bd99-2d616644ce0b-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-788dc538-e6f3-4855-b6eb-68dab608fd9b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-788dc538-e6f3-4855-b6eb-68dab608fd9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-quobyte-005b67d7-eb5e-457d-b2f3-16aef117d0e1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-005b67d7-eb5e-457d-b2f3-16aef117d0e1" acquired by "delete_volume" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-quobyte-788dc538-e6f3-4855-b6eb-68dab608fd9b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[56105e9e-b8a6-4670-b383-abf8be5f3f81]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-788dc538-e6f3-4855-b6eb-68dab608fd9b" acquired by "delete_volume" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9affe1-3675-494f-b730-d6593880b4f3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:08 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 Sep 11 23:18:08 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:08 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 1G" returned: 0 in 0.532s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:08 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b Sep 11 23:18:08 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:08 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 Sep 11 23:18:08 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1" returned: 0 in 0.441s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1 Sep 11 23:18:09 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4" returned: 0 in 0.329s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 is being set with open permissions: ugo+rw Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b" returned: 0 in 0.474s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 Sep 11 23:18:09 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b Sep 11 23:18:09 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-005b67d7-eb5e-457d-b2f3-16aef117d0e1" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-005b67d7-eb5e-457d-b2f3-16aef117d0e1" released by "delete_volume" :: held 0.765s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:09 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Created reservations ['49e32859-596b-428a-9e88-fa33473f5254', '19cb5ad8-02c3-4b58-a02b-b83c0acc0fdd', '692d20ab-ba88-432c-a359-e190ec19b4ad', 'aa83e3ba-9157-4c56-9493-6a54a69a37ce'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4" returned: 0 in 0.275s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-788dc538-e6f3-4855-b6eb-68dab608fd9b" returned: 0 in 0.289s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-788dc538-e6f3-4855-b6eb-68dab608fd9b" released by "delete_volume" :: held 0.810s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info Sep 11 23:18:09 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:09 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created reservations ['ef06fec8-206e-47ef-95e2-3becbac840ae', 'c3091ec0-915b-4b99-8295-ae381eb5ee1a', '91ab67f0-45d6-4d84-a186-63d381d7e4d8', '17031938-048d-4b69-acab-79210a5bcfc7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-85cf2e6a-5517-46cf-aea2-6c262321a6df-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-85cf2e6a-5517-46cf-aea2-6c262321a6df-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "cinder-quobyte-85cf2e6a-5517-46cf-aea2-6c262321a6df" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:09 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:09 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-85cf2e6a-5517-46cf-aea2-6c262321a6df" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819f256-8ec1-4378-9be8-ad7075b42f21]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info is being set with open permissions: ugo+rw Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:09 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Deleted volume successfully. Sep 11 23:18:09 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info Sep 11 23:18:09 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-50672ccd-a8dd-4247-9c6c-ea76ed480869 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-005b67d7-eb5e-457d-b2f3-16aef117d0e1-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:09 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df Sep 11 23:18:09 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:10 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.307s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Deleted volume successfully. Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e7806ed3-f9d1-427b-bc6f-c2a83a965ecc tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-788dc538-e6f3-4855-b6eb-68dab608fd9b-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:10 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.info" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.234s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e64269a-1216-4cdb-b5f6-5e0188555de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827d25aba6c7484fb1928cf920579cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:02Z,use_quota=True,user_id='9daf2093eefd45349e6e435a4a9656c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4965f37f-5ed9-43ca-afbe-a6614a9c52a2),volume_type_id=4965f37f-5ed9-43ca-afbe-a6614a9c52a2)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Creating volume 0e64269a-1216-4cdb-b5f6-5e0188555de4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:10 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:10 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 1073741824 Sep 11 23:18:10 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7c3f7696-cc8d-4453-ad93-9e3cabdbb4d7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Create snapshot completed successfully Sep 11 23:18:10 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df" returned: 0 in 0.425s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:10 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df Sep 11 23:18:10 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:10 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-85cf2e6a-5517-46cf-aea2-6c262321a6df" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-quobyte-85cf2e6a-5517-46cf-aea2-6c262321a6df" released by "delete_volume" :: held 0.777s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:10 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 1073741824" returned: 0 in 0.491s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Created reservations ['10d267ed-fdb9-4656-b670-19e95fe6614f', '62232c01-b645-4ca7-b776-41f435521148', '5bb21807-e77a-479a-bc46-6ee14fa2c00c', '6e70e4eb-d80a-4481-8646-317543875509'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:10 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 Sep 11 23:18:10 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:10 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:10 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-a235f2f9-bf60-4d98-ac8e-4bec2a046495-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-a235f2f9-bf60-4d98-ac8e-4bec2a046495-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:10 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4" returned: 0 in 0.312s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-quobyte-a235f2f9-bf60-4d98-ac8e-4bec2a046495" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Attempting download of b7c6a8e9-a364-491a-9564-1fb46f587d47 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7c6a8e9-a364-491a-9564-1fb46f587d47', 'metadata': {}}])) to volume 0e64269a-1216-4cdb-b5f6-5e0188555de4. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-a235f2f9-bf60-4d98-ac8e-4bec2a046495" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afbed58-2f68-4fce-8c15-3231b8fb83ec]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:11 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0740a0a9-4006-4aa8-ba5b-3b4265664fb6]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.411s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Deleted volume successfully. Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7427f138-b9ce-44e7-9972-227bd042b512 tempest-CreateVolumesFromImageTest-470762212 None] Lock "cinder-85cf2e6a-5517-46cf-aea2-6c262321a6df-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:11 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt Sep 11 23:18:11 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:11 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 Sep 11 23:18:11 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (f55cd8d3-b1e7-4fbb-9a02-47d14eee47e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c07bcb-12c0-4db0-94d1-c761789ebf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c07bcb-12c0-4db0-94d1-c761789ebf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1232125645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c782f8a-206d-41eb-ba11-346656dedfa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:11Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60101609-9fa7-4702-aa86-793393d08246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60101609-9fa7-4702-aa86-793393d08246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23162243-371c-4e8f-9c89-b8964c39a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23162243-371c-4e8f-9c89-b8964c39a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c782f8a-206d-41eb-ba11-346656dedfa5', 'volume_name': 'volume-5c782f8a-206d-41eb-ba11-346656dedfa5', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec043ab6-674f-4d68-93c6-2422aca0efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec043ab6-674f-4d68-93c6-2422aca0efbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255eda41-cdb4-428e-9ed4-37e496dfba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:11 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume 5c782f8a-206d-41eb-ba11-346656dedfa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c782f8a-206d-41eb-ba11-346656dedfa5', 'volume_size': 1} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1232125645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c782f8a-206d-41eb-ba11-346656dedfa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:11Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating volume 5c782f8a-206d-41eb-ba11-346656dedfa5 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:11 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:11 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 1073741824 Sep 11 23:18:11 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:11 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495" returned: 0 in 0.656s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:11 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495 Sep 11 23:18:11 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:11 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt" returned: 0 in 0.723s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (0c5b074c-6885-4e74-be2c-47eaf3a7695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1293622c-ae1f-4841-8bbd-5c2095db58cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt Sep 11 23:18:12 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1293622c-ae1f-4841-8bbd-5c2095db58cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-121280412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f248da63-d1b1-4710-a36f-1e096b1d8808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:12Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5aaeb6f-9af2-44fc-8e3b-4e83c04ade6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5aaeb6f-9af2-44fc-8e3b-4e83c04ade6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4578e5f-8fca-437f-a947-160bdbb3627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4578e5f-8fca-437f-a947-160bdbb3627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f248da63-d1b1-4710-a36f-1e096b1d8808', 'volume_name': 'volume-f248da63-d1b1-4710-a36f-1e096b1d8808', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762196f9-31dc-44f4-a4b8-1119d8fc4f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762196f9-31dc-44f4-a4b8-1119d8fc4f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602581f6-56b4-4ec9-9c4c-ac63717391b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume f248da63-d1b1-4710-a36f-1e096b1d8808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f248da63-d1b1-4710-a36f-1e096b1d8808', 'volume_size': 1} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-a235f2f9-bf60-4d98-ac8e-4bec2a046495" returned: 0 in 0.506s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-a235f2f9-bf60-4d98-ac8e-4bec2a046495" released by "delete_volume" :: held 1.250s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:12 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created reservations ['72205dfb-593e-40e7-9d51-caec7df8aeed', '68204adb-2af2-4a85-9629-1f474aa4642e', 'ca4271ef-3607-4410-88db-37a199c6c634', '8adf1691-0b7b-4b12-ae7f-5dd367326c34'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 1073741824" returned: 0 in 0.909s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:12 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt" returned: 1 in 0.632s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7c6a8e9-a364-491a-9564-1fb46f587d47_lfrsoznt' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ffb545-72ab-44eb-b38c-0fe0ffe97104]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:12 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 Sep 11 23:18:12 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:12 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:12 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:12 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD Sep 11 23:18:12 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (1bc3de70-3dd8-471c-8b9c-497c2d8eba36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60dc365-6463-4857-900a-19ba03f5233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60dc365-6463-4857-900a-19ba03f5233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042269085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9c7218-c4b9-4834-afd7-f8f8b24fe435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:13Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3091b6e-e7da-4b8d-b6ad-06a90c69c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3091b6e-e7da-4b8d-b6ad-06a90c69c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b15808e-c93d-4867-b996-8f9b8e692cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b15808e-c93d-4867-b996-8f9b8e692cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9c7218-c4b9-4834-afd7-f8f8b24fe435', 'volume_name': 'volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0463b6a8-b740-43fe-b520-716fa15313a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0463b6a8-b740-43fe-b520-716fa15313a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fae717-ca5d-483a-8d2e-c6ae9f0225ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume 9f9c7218-c4b9-4834-afd7-f8f8b24fe435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435', 'volume_size': 1} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:12 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.358s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:12 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:13 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5" returned: 0 in 0.464s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Deleted volume successfully. Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-121280412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f248da63-d1b1-4710-a36f-1e096b1d8808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:12Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating volume f248da63-d1b1-4710-a36f-1e096b1d8808 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:13 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255eda41-cdb4-428e-9ed4-37e496dfba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c782f8a-206d-41eb-ba11-346656dedfa5', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a628055f-baf7-4fe9-8ab4-cd08f6a630e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:13 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 1073741824 Sep 11 23:18:13 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cd1d17d4-30ae-4ca4-bb48-43e1346900c5 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-a235f2f9-bf60-4d98-ac8e-4bec2a046495-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume volume-5c782f8a-206d-41eb-ba11-346656dedfa5 (5c782f8a-206d-41eb-ba11-346656dedfa5): created successfully Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a628055f-baf7-4fe9-8ab4-cd08f6a630e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (f55cd8d3-b1e7-4fbb-9a02-47d14eee47e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9359ca79-a719-4746-9bd5-a2449615b7be tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created volume successfully. Sep 11 23:18:13 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD" returned: 0 in 0.787s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-11f30d2d-67d6-4b00-81ee-5d296179b7c2-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (d5e2408c-76cb-428b-b972-dc5d4052d77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e04b793-b62a-4ecb-9e48-a4bab2204112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-11f30d2d-67d6-4b00-81ee-5d296179b7c2-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e04b793-b62a-4ecb-9e48-a4bab2204112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511452005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dc8f9b-f16a-476c-adbb-012eef463219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:13Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad34c9-5082-45b5-8356-63fbf5c62df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad34c9-5082-45b5-8356-63fbf5c62df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177980fb-8991-4afc-bf78-f4ee17d3de16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177980fb-8991-4afc-bf78-f4ee17d3de16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50dc8f9b-f16a-476c-adbb-012eef463219', 'volume_name': 'volume-50dc8f9b-f16a-476c-adbb-012eef463219', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87aa0092-b57c-4d52-9174-1562b79ac11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87aa0092-b57c-4d52-9174-1562b79ac11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:13 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD Sep 11 23:18:13 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4350978b-7c74-490e-b2e1-61b0fa446bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume 50dc8f9b-f16a-476c-adbb-012eef463219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50dc8f9b-f16a-476c-adbb-012eef463219', 'volume_size': 1} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-quobyte-11f30d2d-67d6-4b00-81ee-5d296179b7c2" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-11f30d2d-67d6-4b00-81ee-5d296179b7c2" acquired by "delete_volume" :: waited 0.035s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aff46c-6bc9-4426-8f3d-fc47b150a8e8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:13 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:13 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 Sep 11 23:18:13 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:13 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (53504481-baa3-442b-9994-b8018871fd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c4f9ee-5873-4459-87f4-7b61b458dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD" returned: 1 in 0.681s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] b7c6a8e9-a364-491a-9564-1fb46f587d47 was raw, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:14 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 Sep 11 23:18:14 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c4f9ee-5873-4459-87f4-7b61b458dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274575899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df05d954-0af8-4e50-8d0e-369d1f105b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:14Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b251ff99-5077-404c-b02c-50c9ff7d52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b251ff99-5077-404c-b02c-50c9ff7d52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149ccb31-5fe1-49c4-9e09-69fac13c7029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149ccb31-5fe1-49c4-9e09-69fac13c7029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df05d954-0af8-4e50-8d0e-369d1f105b11', 'volume_name': 'volume-df05d954-0af8-4e50-8d0e-369d1f105b11', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:14 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bade295-e5c2-42ec-bb37-17e25da9e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bade295-e5c2-42ec-bb37-17e25da9e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1994c132-f3f8-47c1-9890-65abad4a7263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:14 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume df05d954-0af8-4e50-8d0e-369d1f105b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df05d954-0af8-4e50-8d0e-369d1f105b11', 'volume_size': 1} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 1073741824" returned: 0 in 1.130s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:14 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 Sep 11 23:18:14 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:14 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2" returned: 0 in 0.502s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:14 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2 Sep 11 23:18:14 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:14 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808" returned: 0 in 0.329s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042269085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9c7218-c4b9-4834-afd7-f8f8b24fe435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:13Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating volume 9f9c7218-c4b9-4834-afd7-f8f8b24fe435 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:14 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:14 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 1073741824 Sep 11 23:18:14 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602581f6-56b4-4ec9-9c4c-ac63717391b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f248da63-d1b1-4710-a36f-1e096b1d8808', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8fd216-ebb0-4e36-b451-be0c961eea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:14 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume volume-f248da63-d1b1-4710-a36f-1e096b1d8808 (f248da63-d1b1-4710-a36f-1e096b1d8808): created successfully Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8fd216-ebb0-4e36-b451-be0c961eea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (0c5b074c-6885-4e74-be2c-47eaf3a7695d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:14 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-11f30d2d-67d6-4b00-81ee-5d296179b7c2" returned: 0 in 0.358s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:14 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-11f30d2d-67d6-4b00-81ee-5d296179b7c2" released by "delete_volume" :: held 0.941s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9f3dd1fc-dab4-4b7f-8d5e-82c7cea22c07 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created volume successfully. Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4" returned: 0 in 0.665s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7c6a8e9-a364-491a-9564-1fb46f587d47_1cg_7wp6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:18:14 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:14 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 1G Sep 11 23:18:14 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created reservations ['c19aa0f3-e99f-48be-9b03-4d6abdd7421a', 'a35483b8-100c-4add-83f8-94b879c8ae34', '0c9a0d10-9b17-4755-890e-c5410d40765f', '92cda7b3-9ae0-4130-b38a-cd73a20d79f1'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:14 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:14 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:15 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 1G" returned: 0 in 0.435s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Downloaded image b7c6a8e9-a364-491a-9564-1fb46f587d47 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7c6a8e9-a364-491a-9564-1fb46f587d47', 'metadata': {}}])) to volume 0e64269a-1216-4cdb-b5f6-5e0188555de4 successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Temporary image b7c6a8e9-a364-491a-9564-1fb46f587d47 for user 9daf2093eefd45349e6e435a4a9656c2 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Marking volume 0e64269a-1216-4cdb-b5f6-5e0188555de4 as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Copying metadata from image b7c6a8e9-a364-491a-9564-1fb46f587d47 to 0e64269a-1216-4cdb-b5f6-5e0188555de4. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Creating volume glance metadata for volume 0e64269a-1216-4cdb-b5f6-5e0188555de4 backed by image b7c6a8e9-a364-491a-9564-1fb46f587d47 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '94d697273a2db1505c9474b932634524', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:18:15 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:15 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 1073741824" returned: 0 in 0.698s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.324s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Deleted volume successfully. Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f613e6-5aef-4ff2-961a-abb3ac0d20d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e64269a-1216-4cdb-b5f6-5e0188555de4', 'volume_size': 1, 'image_id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7c6a8e9-a364-491a-9564-1fb46f587d47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94d697273a2db1505c9474b932634524', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '827d25aba6c7484fb1928cf920579cd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e16ba046c57a608b03f51a7d0c12e79fc0af31f5a84162065fa2175e42dca31c3dfff218c35c7563a27ffb82d4d595804c276690677eee2a3978e1879c958085', 'id': 'b7c6a8e9-a364-491a-9564-1fb46f587d47', 'created_at': datetime.datetime(2026, 9, 11, 21, 17, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7c6a8e9-a364-491a-9564-1fb46f587d47/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b16d83c-5c05-439a-b9fe-07e4448e92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c4cda6f3-2de6-4b62-9eb8-75efc6bc7e3e tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-11f30d2d-67d6-4b00-81ee-5d296179b7c2-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Volume volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 (0e64269a-1216-4cdb-b5f6-5e0188555de4): created successfully Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b16d83c-5c05-439a-b9fe-07e4448e92ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Flow 'volume_create_manager' (b39e10ce-41ff-4240-a369-256edb2b42a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-87e55b4b-6d95-46e4-890e-416b3a69a4b9 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Created volume successfully. Sep 11 23:18:15 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 Sep 11 23:18:15 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:15 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511452005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dc8f9b-f16a-476c-adbb-012eef463219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:13Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating volume 50dc8f9b-f16a-476c-adbb-012eef463219 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:15 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 1073741824 Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fae717-ca5d-483a-8d2e-c6ae9f0225ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c253d2c-dac8-4070-a322-81caed021165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 (9f9c7218-c4b9-4834-afd7-f8f8b24fe435): created successfully Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c253d2c-dac8-4070-a322-81caed021165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (1bc3de70-3dd8-471c-8b9c-497c2d8eba36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2082b737-fa2d-4b5a-b1fc-3b967def3a14 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created volume successfully. Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Flow 'volume_create_manager' (fb50a156-29cb-4326-a703-5689fb3c7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad66501-1c7e-4d07-bdd6-6afddca06eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Acquiring lock "cinder-0e64269a-1216-4cdb-b5f6-5e0188555de4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad66501-1c7e-4d07-bdd6-6afddca06eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1272713083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59815ebb-49a0-430f-808a-d545ec3a45d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4355cce379464c41ac9c442a444dc7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:16Z,use_quota=True,user_id='cb612581885e4f4aaaa927e242ada8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8fe4d5-5d95-4358-ad47-3b8fb79f961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8fe4d5-5d95-4358-ad47-3b8fb79f961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3778370-e36b-42a1-9720-29eb58106964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3778370-e36b-42a1-9720-29eb58106964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59815ebb-49a0-430f-808a-d545ec3a45d9', 'volume_name': 'volume-59815ebb-49a0-430f-808a-d545ec3a45d9', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670552db-dc02-495f-a3f5-96a68bad7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670552db-dc02-495f-a3f5-96a68bad7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8e86f-5465-4469-a214-c484e27561ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Volume 59815ebb-49a0-430f-808a-d545ec3a45d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59815ebb-49a0-430f-808a-d545ec3a45d9', 'volume_size': 1} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "cinder-0e64269a-1216-4cdb-b5f6-5e0188555de4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Acquiring lock "cinder-quobyte-0e64269a-1216-4cdb-b5f6-5e0188555de4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-db1dd55f-5d5a-451c-82dc-8637a2504218-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "cinder-quobyte-0e64269a-1216-4cdb-b5f6-5e0188555de4" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-db1dd55f-5d5a-451c-82dc-8637a2504218-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d59db4-77fb-4377-9692-c21ec3e84bce]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-quobyte-db1dd55f-5d5a-451c-82dc-8637a2504218" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-db1dd55f-5d5a-451c-82dc-8637a2504218" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a36a951-68f8-4a31-b652-c4fc3457d0d8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 Sep 11 23:18:16 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 Sep 11 23:18:16 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 1073741824" returned: 0 in 0.621s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 Sep 11 23:18:16 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4" returned: 0 in 0.450s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4 Sep 11 23:18:16 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218" returned: 0 in 0.423s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218 Sep 11 23:18:16 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219" returned: 0 in 0.267s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.419s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274575899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df05d954-0af8-4e50-8d0e-369d1f105b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d9ec76e6a2433f8d962b19d1e7c0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:14Z,use_quota=True,user_id='9832fed49e7e4c79a04656cf3b372f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Creating volume df05d954-0af8-4e50-8d0e-369d1f105b11 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:16 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 1073741824 Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4350978b-7c74-490e-b2e1-61b0fa446bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50dc8f9b-f16a-476c-adbb-012eef463219', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:16 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f94916-6ac7-4cd4-8d50-2610c3706ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:16 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume volume-50dc8f9b-f16a-476c-adbb-012eef463219 (50dc8f9b-f16a-476c-adbb-012eef463219): created successfully Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f94916-6ac7-4cd4-8d50-2610c3706ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (d5e2408c-76cb-428b-b972-dc5d4052d77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:16 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:16 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-79fe17a6-0779-4711-81ae-1908d84b5b4e tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created volume successfully. Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0e64269a-1216-4cdb-b5f6-5e0188555de4" returned: 0 in 0.286s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "cinder-quobyte-0e64269a-1216-4cdb-b5f6-5e0188555de4" released by "delete_volume" :: held 0.779s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:16 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-db1dd55f-5d5a-451c-82dc-8637a2504218" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Created reservations ['d9a87b5e-d892-461d-ae07-a9e1a50e0c81', '6b5b9543-af32-4446-8458-d57c1c23aa6e', 'bb487078-abfc-4206-bcdb-de8a97aa7a17', 'c6455ae7-048f-4fed-9aa0-92b67d7169b7'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-db1dd55f-5d5a-451c-82dc-8637a2504218" released by "delete_volume" :: held 0.760s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created reservations ['696263fc-2652-4160-8484-844ddc506ffd', 'fa909d09-ec82-44c7-be98-93b8c99db3fa', 'de6c90e6-70d7-4e07-b66a-250f9961e4a4', '6b246d6a-50ea-4029-930b-346082c93979'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:16 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:16 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:17 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:17 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-57da93df-1de9-43bb-b807-e961f8f97730-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:17 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-57da93df-1de9-43bb-b807-e961f8f97730-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Deleted volume successfully. Sep 11 23:18:17 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 1073741824" returned: 0 in 0.638s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8f831d93-8ced-4262-8e3f-26b7fa50b405 tempest-VolumeAndVolumeTypeFromImageTest-2018221449 None] Lock "cinder-0e64269a-1216-4cdb-b5f6-5e0188555de4-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-quobyte-57da93df-1de9-43bb-b807-e961f8f97730" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-57da93df-1de9-43bb-b807-e961f8f97730" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ea6642-da85-4adc-8e95-17afa30f4413]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:17 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 Sep 11 23:18:17 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:17 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.444s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:17 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 Sep 11 23:18:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Deleted volume successfully. Sep 11 23:18:17 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-b996a565-f444-4242-a0c9-b5ba2e099e30 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-db1dd55f-5d5a-451c-82dc-8637a2504218-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:17 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1272713083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59815ebb-49a0-430f-808a-d545ec3a45d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4355cce379464c41ac9c442a444dc7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:16Z,use_quota=True,user_id='cb612581885e4f4aaaa927e242ada8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Creating volume 59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:17 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1994c132-f3f8-47c1-9890-65abad4a7263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df05d954-0af8-4e50-8d0e-369d1f105b11', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:17 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 1073741824 Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868c7382-c64a-46eb-b1e3-0db0edffbe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:17 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:17 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Volume volume-df05d954-0af8-4e50-8d0e-369d1f105b11 (df05d954-0af8-4e50-8d0e-369d1f105b11): created successfully Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868c7382-c64a-46eb-b1e3-0db0edffbe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Flow 'volume_create_manager' (53504481-baa3-442b-9994-b8018871fd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:17 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cbce02db-df8e-42dd-a0ba-f66ac773ca48 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created volume successfully. Sep 11 23:18:17 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730" returned: 0 in 0.479s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:17 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730 Sep 11 23:18:17 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:18 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-57da93df-1de9-43bb-b807-e961f8f97730" returned: 0 in 0.252s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-57da93df-1de9-43bb-b807-e961f8f97730" released by "delete_volume" :: held 0.787s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created reservations ['341c05c4-92f3-4472-a485-a3bb4b403629', 'daec81f5-fc5e-4c9a-9058-d11d80a81344', '7f51e09a-d874-4ccc-9235-fda123c7e462', '712e6df9-05aa-483d-8a00-62e17b94ae57'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:18 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 1073741824" returned: 0 in 0.530s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:18 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:18 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:18 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 Sep 11 23:18:18 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-1da5814c-53e9-4e72-8614-b565d93dbdcf-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-1da5814c-53e9-4e72-8614-b565d93dbdcf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "cinder-quobyte-1da5814c-53e9-4e72-8614-b565d93dbdcf" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-1da5814c-53e9-4e72-8614-b565d93dbdcf" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1179449d-7fd1-4487-b2c6-c0ccd1f5e606]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:18 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Deleted volume successfully. Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ad4ed2a1-0d4a-4f1c-9a91-e3515b9813f1 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-57da93df-1de9-43bb-b807-e961f8f97730-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-df05d954-0af8-4e50-8d0e-369d1f105b11-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:18 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf Sep 11 23:18:18 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-df05d954-0af8-4e50-8d0e-369d1f105b11-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:18 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9" returned: 0 in 0.430s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8e86f-5465-4469-a214-c484e27561ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59815ebb-49a0-430f-808a-d545ec3a45d9', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1bee40-7934-4f12-ac12-322a3ba0c40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-df05d954-0af8-4e50-8d0e-369d1f105b11" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:18 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Volume volume-59815ebb-49a0-430f-808a-d545ec3a45d9 (59815ebb-49a0-430f-808a-d545ec3a45d9): created successfully Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1bee40-7934-4f12-ac12-322a3ba0c40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Flow 'volume_create_manager' (fb50a156-29cb-4326-a703-5689fb3c7f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-df05d954-0af8-4e50-8d0e-369d1f105b11" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-900137f6-4085-4ca5-a207-44950c8bab18 tempest-VolumeDependencyTests-1296821888 None] Created volume successfully. Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08feb7f-26eb-4945-8d55-3c635c19b5b8]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:18 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf" returned: 0 in 0.488s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:18 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 Sep 11 23:18:18 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:18 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf Sep 11 23:18:18 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Creating offline snapshot d5719dfb-25b4-46ab-ab1c-a0c2765dc300 of volume 59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123c631-3821-4d95-b43d-797b8557dcb0]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:19 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1da5814c-53e9-4e72-8614-b565d93dbdcf" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-quobyte-1da5814c-53e9-4e72-8614-b565d93dbdcf" released by "delete_volume" :: held 0.893s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:19 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11" returned: 0 in 0.494s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:19 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 Sep 11 23:18:19 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:19 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11 Sep 11 23:18:19 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Created reservations ['10c13325-7ab5-4443-a2c3-bc7babc2a9cb', 'c47fd2de-babb-4b2c-b492-274878497e33', 'b5fb8606-a5db-4d6d-b67c-79284a7037f7', '66a24255-e132-4e68-852f-a5572b65edd8'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:19 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:19 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:19 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9" returned: 0 in 0.450s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:19 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-df05d954-0af8-4e50-8d0e-369d1f105b11" returned: 0 in 0.363s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:19 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 1G Sep 11 23:18:19 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-df05d954-0af8-4e50-8d0e-369d1f105b11" released by "delete_volume" :: held 0.929s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['0e5c4e5c-a958-46c6-83f4-b423b78bec27', '991939cb-50b4-4ead-9a1d-0a6476964863', '63d1fc7c-65fb-439b-8376-394a89f6e2f0', 'f5514aa9-0977-49ce-9d96-2c28389b5e5c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:19 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Deleted volume successfully. Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:19 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:19 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-2e51d4ae-c7ea-4830-88e6-49140d1abce7 tempest-CreateVolumesFromSourceVolumeTest-869453405 None] Lock "cinder-1da5814c-53e9-4e72-8614-b565d93dbdcf-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:20 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 1G" returned: 0 in 0.556s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59815ebb-49a0-430f-808a-d545ec3a45d9 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:20 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:20 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleted volume successfully. Sep 11 23:18:20 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59815ebb-49a0-430f-808a-d545ec3a45d9 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 Sep 11 23:18:20 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9840543e-f170-4182-87f5-8aee2159943b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-df05d954-0af8-4e50-8d0e-369d1f105b11-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:20 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59815ebb-49a0-430f-808a-d545ec3a45d9 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300" returned: 0 in 0.328s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 is being set with open permissions: ugo+rw Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:20 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 Sep 11 23:18:20 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:20 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:20 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info Sep 11 23:18:20 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-50dc8f9b-f16a-476c-adbb-012eef463219-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-50dc8f9b-f16a-476c-adbb-012eef463219-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-50dc8f9b-f16a-476c-adbb-012eef463219" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-50dc8f9b-f16a-476c-adbb-012eef463219" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[436eec40-6f61-453b-b74e-c13497adee5a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:21 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info" returned: 0 in 0.310s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:21 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info is being set with open permissions: ugo+rw Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:21 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 Sep 11 23:18:21 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:21 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info Sep 11 23:18:21 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:21 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219" returned: 0 in 0.439s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:21 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219 Sep 11 23:18:21 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:21 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.info" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e46c2492-ac5c-4397-b701-3e60a8ded568 tempest-VolumeDependencyTests-1296821888 None] Create snapshot completed successfully Sep 11 23:18:21 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-50dc8f9b-f16a-476c-adbb-012eef463219" returned: 0 in 0.293s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-50dc8f9b-f16a-476c-adbb-012eef463219" released by "delete_volume" :: held 0.789s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['e34b3f3f-a69a-48e5-8b42-5082032914b8', 'e21fd793-eb69-430f-9f92-5fda558bd145', '9e0b95e9-aa0a-4a9b-b381-0f487e5d0978', 'f21e5d36-c47f-432a-ba8a-92ab9cd2b99c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:21 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:21 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-9f9c7218-c4b9-4834-afd7-f8f8b24fe435-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-9f9c7218-c4b9-4834-afd7-f8f8b24fe435-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:22 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.312s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-9f9c7218-c4b9-4834-afd7-f8f8b24fe435" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:22 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleted volume successfully. Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-9f9c7218-c4b9-4834-afd7-f8f8b24fe435" acquired by "delete_volume" :: waited 0.032s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-56230c24-8d13-4f96-8d42-e51588a2487b tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-50dc8f9b-f16a-476c-adbb-012eef463219-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a6ee3-c22a-452f-ad02-d0923051bac0]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:22 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 Sep 11 23:18:22 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:22 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435" returned: 0 in 0.447s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:22 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435 Sep 11 23:18:22 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:23 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Flow 'volume_create_manager' (6c394418-9a35-4ef8-a330-8db7b9593016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382dba6c-8c2e-40e0-a561-1f9eefd1525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f9c7218-c4b9-4834-afd7-f8f8b24fe435" returned: 0 in 0.388s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382dba6c-8c2e-40e0-a561-1f9eefd1525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1330066652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6615732-3a7e-4d80-a4c3-eb016d811d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4355cce379464c41ac9c442a444dc7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5719dfb-25b4-46ab-ab1c-a0c2765dc300,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:23Z,use_quota=True,user_id='cb612581885e4f4aaaa927e242ada8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b0634f-df9d-4feb-a35c-b5a21de0f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b0634f-df9d-4feb-a35c-b5a21de0f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb58a6-3f97-4899-99e4-232c24be1682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb58a6-3f97-4899-99e4-232c24be1682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6615732-3a7e-4d80-a4c3-eb016d811d58', 'volume_name': 'volume-d6615732-3a7e-4d80-a4c3-eb016d811d58', 'volume_size': 1, 'snapshot_id': 'd5719dfb-25b4-46ab-ab1c-a0c2765dc300'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742243cd-9207-46e6-b690-0b1e6e1ef22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742243cd-9207-46e6-b690-0b1e6e1ef22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c11633-cbd6-4efb-bc31-0b7f08f00a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Volume d6615732-3a7e-4d80-a4c3-eb016d811d58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6615732-3a7e-4d80-a4c3-eb016d811d58', 'volume_size': 1, 'snapshot_id': 'd5719dfb-25b4-46ab-ab1c-a0c2765dc300'} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-9f9c7218-c4b9-4834-afd7-f8f8b24fe435" released by "delete_volume" :: held 0.926s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-quobyte-d5719dfb-25b4-46ab-ab1c-a0c2765dc300-d6615732-3a7e-4d80-a4c3-eb016d811d58" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d5719dfb-25b4-46ab-ab1c-a0c2765dc300-d6615732-3a7e-4d80-a4c3-eb016d811d58" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Creating volume d6615732-3a7e-4d80-a4c3-eb016d811d58 from snapshot d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-quobyte-d6615732-3a7e-4d80-a4c3-eb016d811d58" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d6615732-3a7e-4d80-a4c3-eb016d811d58" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] snapshot: d5719dfb-25b4-46ab-ab1c-a0c2765dc300, volume: d6615732-3a7e-4d80-a4c3-eb016d811d58, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b172e-cd71-482c-9c4c-77f1e89894d6]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['7669d954-64f2-4526-88cc-e1124abb5df7', 'c50ad6d3-7bcb-4bdd-b1e8-2d5d19fdf02c', '66b7bdd9-5185-47e0-9d87-63192fb41125', '9e1d724e-8925-4f3a-b0ca-3f26fc2a9b36'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:23 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 Sep 11 23:18:23 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:23 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:23 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:23 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleted volume successfully. Sep 11 23:18:23 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300" returned: 0 in 0.506s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59815ebb-49a0-430f-808a-d545ec3a45d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-76d06087-b2e3-4cb5-8988-b1b3c6897602 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-9f9c7218-c4b9-4834-afd7-f8f8b24fe435-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce0a8d-49d9-46b1-8318-359cb5fbad1c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:23 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 Sep 11 23:18:23 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:24 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9" returned: 0 in 0.392s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:24 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 Sep 11 23:18:24 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-f248da63-d1b1-4710-a36f-1e096b1d8808-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-f248da63-d1b1-4710-a36f-1e096b1d8808-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-f248da63-d1b1-4710-a36f-1e096b1d8808" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-f248da63-d1b1-4710-a36f-1e096b1d8808" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[13083a5c-1641-499f-8dd5-b54fb6d274c5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:24 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 Sep 11 23:18:24 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:25 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808" returned: 0 in 0.693s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:25 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808 Sep 11 23:18:25 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:25 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-f248da63-d1b1-4710-a36f-1e096b1d8808" returned: 0 in 0.618s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-f248da63-d1b1-4710-a36f-1e096b1d8808" released by "delete_volume" :: held 1.401s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['5d33d4c9-47ea-4948-ac7f-1ae4b519357d', '5b82702a-c6cb-4ce4-a06a-f27ed6c5d72a', '9020bed6-92ac-4af5-9672-62f1d36d59c8', 'b0ae0eb4-fd99-4417-8fb3-5a4380efe06c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:26 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:26 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:27 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.644s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleted volume successfully. Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e29c4e47-fcda-436c-9150-5746d49e1db7 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-f248da63-d1b1-4710-a36f-1e096b1d8808-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Flow 'volume_create_manager' (1c6076ba-c07e-4e4c-ba09-e19fb1e63817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b98f56c-13ed-4c0f-a8fd-255d619089be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-5c782f8a-206d-41eb-ba11-346656dedfa5-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b98f56c-13ed-4c0f-a8fd-255d619089be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e0774b9c8f4e7390dd64c73b33c098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:27Z,use_quota=True,user_id='3681d34344ff4313b3229cc736eed9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd301ea-e76f-47fb-a82c-1694b7d27c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd301ea-e76f-47fb-a82c-1694b7d27c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998cbec9-b794-4b0a-8ca5-2d55abf1ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.image.glance [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Creating Keystone auth plugin from conf {{(pid=88002) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-5c782f8a-206d-41eb-ba11-346656dedfa5-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-5c782f8a-206d-41eb-ba11-346656dedfa5" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-5c782f8a-206d-41eb-ba11-346656dedfa5" acquired by "delete_volume" :: waited 0.051s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b7714d-0dfc-4882-85bc-e85e28ed69de]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:28 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 Sep 11 23:18:28 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998cbec9-b794-4b0a-8ca5-2d55abf1ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0', 'volume_name': 'volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0', 'volume_size': 1, 'image_id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f491fe2a-d350-4d58-83f5-3076f0631ccd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '888fd8f89c8579cafb4e0b3fa9a76530', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7e0774b9c8f4e7390dd64c73b33c098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94641d18aac2b57e9fc4851031002c3c82ce38e3fe126cc7c7dde53684cc29630acf6f20e1f6f6d1fd94b168a38eaa63325cc11e2234c6ebd9d7d7d8f5993273', 'id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'created_at': datetime.datetime(2026, 9, 11, 21, 18, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 18, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f491fe2a-d350-4d58-83f5-3076f0631ccd/file', 'properties': {}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e1f6b5-7a2c-4185-80e1-51a9ecb23a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e1f6b5-7a2c-4185-80e1-51a9ecb23a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7f19d9-56f9-4699-a7c2-c8d935c12e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:28 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Volume 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0', 'volume_size': 1, 'image_id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f491fe2a-d350-4d58-83f5-3076f0631ccd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '888fd8f89c8579cafb4e0b3fa9a76530', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7e0774b9c8f4e7390dd64c73b33c098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94641d18aac2b57e9fc4851031002c3c82ce38e3fe126cc7c7dde53684cc29630acf6f20e1f6f6d1fd94b168a38eaa63325cc11e2234c6ebd9d7d7d8f5993273', 'id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'created_at': datetime.datetime(2026, 9, 11, 21, 18, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 18, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f491fe2a-d350-4d58-83f5-3076f0631ccd/file', 'properties': {}}, 'image_service': } Sep 11 23:18:28 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Trying to clone 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 from image f491fe2a-d350-4d58-83f5-3076f0631ccd at location (None, [{'url': 'file:///opt/stack/data/glance/images/f491fe2a-d350-4d58-83f5-3076f0631ccd', 'metadata': {}}]). {{(pid=88002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:18:28 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5" returned: 0 in 1.224s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:29 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5 Sep 11 23:18:29 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:18:29 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e852130-d1f3-46f9-87ba-0ada2c925dc1]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:29 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD Sep 11 23:18:29 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:29 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5c782f8a-206d-41eb-ba11-346656dedfa5" returned: 0 in 0.706s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-5c782f8a-206d-41eb-ba11-346656dedfa5" released by "delete_volume" :: held 2.056s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:29 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['be96e5f1-eaf0-4d12-bd1a-0663a2ee7801', '7ec66bfd-fdc8-4ca5-91d5-a3f30d49a2d3', '7328ba5e-ae75-40fd-85cc-1ef4b9b412a9', '3b1c7880-9e2c-4241-80ae-21005ac2623b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:30 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58" returned: 0 in 5.936s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:18:30 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Converted 1024.00 MB image at 172.36 MB/s Sep 11 23:18:30 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 is being set with open permissions: ugo+rw Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:30 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:30 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:30 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 Sep 11 23:18:30 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:30 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:30 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD Sep 11 23:18:30 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:30 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.322s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleted volume successfully. Sep 11 23:18:30 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-333fd7d8-b461-4c99-bf3c-b47a656113a8 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-5c782f8a-206d-41eb-ba11-346656dedfa5-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58" returned: 0 in 0.326s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d6615732-3a7e-4d80-a4c3-eb016d811d58" released by "_copy_volume_from_snapshot" :: held 7.299s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d5719dfb-25b4-46ab-ab1c-a0c2765dc300-d6615732-3a7e-4d80-a4c3-eb016d811d58" released by "_create_volume_from_snapshot" :: held 7.370s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.387s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c11633-cbd6-4efb-bc31-0b7f08f00a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6615732-3a7e-4d80-a4c3-eb016d811d58', 'volume_size': 1, 'snapshot_id': 'd5719dfb-25b4-46ab-ab1c-a0c2765dc300'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c6db63-afb3-4266-8354-39f1b57c12f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Volume volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 (d6615732-3a7e-4d80-a4c3-eb016d811d58): created successfully Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c6db63-afb3-4266-8354-39f1b57c12f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:30 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Flow 'volume_create_manager' (6c394418-9a35-4ef8-a330-8db7b9593016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Temporary image f491fe2a-d350-4d58-83f5-3076f0631ccd is fetched for user 3681d34344ff4313b3229cc736eed9d5. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:18:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3f0d9a72-3b0a-4de3-aa17-0709ad37c5bc tempest-VolumeDependencyTests-1296821888 None] Created volume successfully. Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[667416b7-7d8f-4ac2-aa2a-5b3cdaac8fc1]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:30 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD Sep 11 23:18:30 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-6e4974cf-1044-489b-929e-296b110be3a4-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-6e4974cf-1044-489b-929e-296b110be3a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-9f152a14-b8ca-46e9-a36f-1e10336cd681" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-9f152a14-b8ca-46e9-a36f-1e10336cd681" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-6e4974cf-1044-489b-929e-296b110be3a4" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-6e4974cf-1044-489b-929e-296b110be3a4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleting offline snapshot 6e4974cf-1044-489b-929e-296b110be3a4 of volume 9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] snapshot_file for this snap is: volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:18:31 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed977033-9b20-420f-b5a4-6893222038d7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:31 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD Sep 11 23:18:31 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:31 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 Sep 11 23:18:31 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:31 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e0774b9c8f4e7390dd64c73b33c098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:27Z,use_quota=True,user_id='3681d34344ff4313b3229cc736eed9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Creating volume 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:31 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:31 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 1073741824 Sep 11 23:18:31 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:31 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4" returned: 0 in 0.477s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f152a14-b8ca-46e9-a36f-1e10336cd681(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-d5719dfb-25b4-46ab-ab1c-a0c2765dc300-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c74c5e-8b8f-4dc7-82e5-3f72f0f6a412]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-d5719dfb-25b4-46ab-ab1c-a0c2765dc300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-quobyte-59815ebb-49a0-430f-808a-d545ec3a45d9" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-59815ebb-49a0-430f-808a-d545ec3a45d9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-quobyte-d5719dfb-25b4-46ab-ab1c-a0c2765dc300" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d5719dfb-25b4-46ab-ab1c-a0c2765dc300" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Deleting offline snapshot d5719dfb-25b4-46ab-ab1c-a0c2765dc300 of volume 59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] snapshot_file for this snap is: volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cff597-8c30-4380-8d6d-1e344c18ae41]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:31 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 Sep 11 23:18:31 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:31 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 Sep 11 23:18:31 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:32 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 1073741824" returned: 0 in 0.593s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:32 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 Sep 11 23:18:32 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:32 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681" returned: 0 in 0.479s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:32 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 Sep 11 23:18:32 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:32 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300" returned: 0 in 0.534s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59815ebb-49a0-430f-808a-d545ec3a45d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[76776459-ca10-4209-8d2d-dbaf43e51f57]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:32 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" returned: 0 in 0.312s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Attempting download of f491fe2a-d350-4d58-83f5-3076f0631ccd ((None, [{'url': 'file:///opt/stack/data/glance/images/f491fe2a-d350-4d58-83f5-3076f0631ccd', 'metadata': {}}])) to volume 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:18:32 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 Sep 11 23:18:32 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:32 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c09590-5a82-43c5-8826-8e8e8b4e3496]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:32 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4 Sep 11 23:18:32 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:32 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh Sep 11 23:18:32 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:32 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681.6e4974cf-1044-489b-929e-296b110be3a4" returned: 0 in 0.298s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-6e4974cf-1044-489b-929e-296b110be3a4" released by "_delete_snapshot" :: held 1.801s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-9f152a14-b8ca-46e9-a36f-1e10336cd681" released by "delete_snapshot" :: held 1.832s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:32 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh" returned: 0 in 0.406s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:32 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['bf6c52ae-71ff-4f0a-b6f2-0ed922c628a5', '7fbdb4c9-acd3-4c58-8f5d-6930e8afd246', '17d30cb9-9244-40fd-8409-7df0ab1e92d7', 'c91c44d2-72ea-42b7-a5d9-d975ae079d29'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:33 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9" returned: 0 in 0.645s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:33 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 Sep 11 23:18:33 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Delete snapshot completed successfully. Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-af19ad39-928e-4fef-b830-896a538a2fcf tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-6e4974cf-1044-489b-929e-296b110be3a4-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:33 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh Sep 11 23:18:33 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-9f152a14-b8ca-46e9-a36f-1e10336cd681-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-9f152a14-b8ca-46e9-a36f-1e10336cd681-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "cinder-quobyte-9f152a14-b8ca-46e9-a36f-1e10336cd681" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-9f152a14-b8ca-46e9-a36f-1e10336cd681" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[1954748c-64b8-47bb-9244-03011a26fd78]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:33 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh" returned: 1 in 0.446s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f491fe2a-d350-4d58-83f5-3076f0631ccd_hq5baxuh' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a28ed-c278-4c06-8f95-87d065dd7e90]: (4, 'raw') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:33 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300" returned: 0 in 0.468s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:33 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300 Sep 11 23:18:33 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 Sep 11 23:18:33 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD Sep 11 23:18:33 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9.d5719dfb-25b4-46ab-ab1c-a0c2765dc300" returned: 0 in 0.362s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:33 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:33 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681" returned: 0 in 0.515s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d5719dfb-25b4-46ab-ab1c-a0c2765dc300" released by "_delete_snapshot" :: held 2.158s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-59815ebb-49a0-430f-808a-d545ec3a45d9" released by "delete_snapshot" :: held 2.196s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:33 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681 Sep 11 23:18:33 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD Sep 11 23:18:33 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:33 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Created reservations ['cee7cb63-acec-439a-8be7-81eab7c9d0b5', 'd75c9759-c176-4555-a83f-029f11dc102b', '4a2a3fb2-9254-48e4-8f62-a4bf2cd5c6c6', 'd9d71d67-414d-4915-a48f-de60e4985bff'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Delete snapshot completed successfully. Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9f6d7bb8-f3f4-4a9b-9aca-22dda902c4c4 tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-d5719dfb-25b4-46ab-ab1c-a0c2765dc300-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:34 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:34 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] f491fe2a-d350-4d58-83f5-3076f0631ccd was raw, converting to qcow2 {{(pid=88002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-9f152a14-b8ca-46e9-a36f-1e10336cd681" returned: 0 in 0.314s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:34 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 Sep 11 23:18:34 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-quobyte-9f152a14-b8ca-46e9-a36f-1e10336cd681" released by "delete_volume" :: held 0.905s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Created reservations ['b1020a33-cf01-4af8-b116-59bfe3ca6521', 'ef216a1e-e1e2-49c9-9d2a-adc2cd5ccb98', 'a3f27cfa-df65-4c3d-8ac1-6c984058af94', '02b257e4-63fe-4ea1-8579-d92fe40fe978'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:34 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:34 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:34 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.268s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Deleted volume successfully. Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38cd1c0d-428f-461d-9d39-9a88324f7900 tempest-CreateVolumesFromSnapshotTest-1587527001 None] Lock "cinder-9f152a14-b8ca-46e9-a36f-1e10336cd681-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:34 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" returned: 0 in 0.490s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f491fe2a-d350-4d58-83f5-3076f0631ccd_jqywf_qadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:18:34 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:34 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 1G Sep 11 23:18:34 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-59815ebb-49a0-430f-808a-d545ec3a45d9-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-59815ebb-49a0-430f-808a-d545ec3a45d9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-quobyte-59815ebb-49a0-430f-808a-d545ec3a45d9" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-59815ebb-49a0-430f-808a-d545ec3a45d9" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d037613a-49da-4884-8c0e-60314d826898]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:35 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 1G" returned: 0 in 0.418s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Downloaded image f491fe2a-d350-4d58-83f5-3076f0631ccd ((None, [{'url': 'file:///opt/stack/data/glance/images/f491fe2a-d350-4d58-83f5-3076f0631ccd', 'metadata': {}}])) to volume 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 successfully. {{(pid=88002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Temporary image f491fe2a-d350-4d58-83f5-3076f0631ccd for user 3681d34344ff4313b3229cc736eed9d5 is deleted. {{(pid=88002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.volume_utils [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Marking volume 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 as bootable. {{(pid=88002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Copying metadata from image f491fe2a-d350-4d58-83f5-3076f0631ccd to 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0. {{(pid=88002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Creating volume glance metadata for volume 4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 backed by image f491fe2a-d350-4d58-83f5-3076f0631ccd with: {'image_id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '888fd8f89c8579cafb4e0b3fa9a76530', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7f19d9-56f9-4699-a7c2-c8d935c12e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0', 'volume_size': 1, 'image_id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f491fe2a-d350-4d58-83f5-3076f0631ccd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '888fd8f89c8579cafb4e0b3fa9a76530', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7e0774b9c8f4e7390dd64c73b33c098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94641d18aac2b57e9fc4851031002c3c82ce38e3fe126cc7c7dde53684cc29630acf6f20e1f6f6d1fd94b168a38eaa63325cc11e2234c6ebd9d7d7d8f5993273', 'id': 'f491fe2a-d350-4d58-83f5-3076f0631ccd', 'created_at': datetime.datetime(2026, 9, 11, 21, 18, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 18, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f491fe2a-d350-4d58-83f5-3076f0631ccd/file', 'properties': {}}, 'image_service': }' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e6e008-b630-4083-96f8-d324902152df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:35 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Volume volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 (4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0): created successfully Sep 11 23:18:35 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 Sep 11 23:18:35 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e6e008-b630-4083-96f8-d324902152df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Flow 'volume_create_manager' (1c6076ba-c07e-4e4c-ba09-e19fb1e63817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b534f675-9b7c-48b1-a8de-7c2979838843 tempest-VolumeImageDependencyTests-402578537 None] Created volume successfully. Sep 11 23:18:35 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9" returned: 0 in 0.525s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:35 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9 Sep 11 23:18:35 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Acquiring lock "cinder-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Lock "cinder-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Acquiring lock "cinder-quobyte-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Lock "cinder-quobyte-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceabd21d-69c3-4170-85a7-d4b5e3a30f3d]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:35 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-59815ebb-49a0-430f-808a-d545ec3a45d9" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-59815ebb-49a0-430f-808a-d545ec3a45d9" released by "delete_volume" :: held 0.941s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:36 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 Sep 11 23:18:36 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Created reservations ['c4347965-b6ed-4ac2-b54f-816e0ea275ca', '6b64e073-f5c0-41ed-b48e-2bb66e741bec', '02116e56-a2fb-4fcd-b0d3-7d6e6ff96792', '79a1218b-443b-43f6-86bd-acb06bf18d0b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:36 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:36 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:36 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" returned: 0 in 0.544s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:36 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0 Sep 11 23:18:36 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:36 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.313s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Deleted volume successfully. Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-5d998ea0-a645-4769-b681-a636bf87140c tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-59815ebb-49a0-430f-808a-d545ec3a45d9-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:36 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Lock "cinder-quobyte-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0" released by "delete_volume" :: held 0.885s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Created reservations ['7f44bf61-041d-4d8f-a0b1-ca266aee683d', '2b041ec5-c769-4ff2-b0cc-361c7c14d38e', 'ad71adc0-9be0-43d0-9148-66b76613674d', '2e265e24-bc8d-431f-91fa-a892e94e32a0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:36 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:36 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:37 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.293s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Deleted volume successfully. Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1136e20b-60fa-4b8f-9a87-966eb136a9e2 tempest-VolumeImageDependencyTests-402578537 None] Lock "cinder-4dd5b17c-f7c8-4c52-9781-c9058fd2a1e0-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-d6615732-3a7e-4d80-a4c3-eb016d811d58-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-d6615732-3a7e-4d80-a4c3-eb016d811d58-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "cinder-quobyte-d6615732-3a7e-4d80-a4c3-eb016d811d58" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d6615732-3a7e-4d80-a4c3-eb016d811d58" acquired by "delete_volume" :: waited 0.028s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c2a20-5665-432b-afc2-b4bedd9408fd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:37 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 Sep 11 23:18:37 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:37 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58" returned: 0 in 0.526s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:37 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58 Sep 11 23:18:37 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:38 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-d6615732-3a7e-4d80-a4c3-eb016d811d58" returned: 0 in 0.299s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-quobyte-d6615732-3a7e-4d80-a4c3-eb016d811d58" released by "delete_volume" :: held 0.897s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Created reservations ['03bec6b5-dc16-4195-a510-ba041a958e63', '8ad2e5be-3d9a-4848-a2d6-eb225de68afa', '24312f5e-15da-41cb-b0c8-9185733a3781', 'c62220e4-6494-4ab1-a3b8-0b77a809d420'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:38 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:38 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:38 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.333s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:38 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Deleted volume successfully. Sep 11 23:18:38 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3075a3fd-dff1-4e2d-81a4-df5eda08a73d tempest-VolumeDependencyTests-1296821888 None] Lock "cinder-d6615732-3a7e-4d80-a4c3-eb016d811d58-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (caab1988-b7ec-4a18-b4f5-6b54c078ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b436f7-6531-44d8-8148-dbb43b68d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b436f7-6531-44d8-8148-dbb43b68d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453383720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d0bfbe-f536-4c69-aa7c-2fe68e204ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:39Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09a7ac5-1efc-46c7-a303-831a65b97145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09a7ac5-1efc-46c7-a303-831a65b97145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b24b06-4508-45e4-9156-f487a2109f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b24b06-4508-45e4-9156-f487a2109f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d0bfbe-f536-4c69-aa7c-2fe68e204ef4', 'volume_name': 'volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e20052-e943-4d60-aa7a-7b2a8bb72fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e20052-e943-4d60-aa7a-7b2a8bb72fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ffbcc5-fe83-484c-a1a6-d547fb3bb204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Volume 55d0bfbe-f536-4c69-aa7c-2fe68e204ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4', 'volume_size': 1} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453383720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d0bfbe-f536-4c69-aa7c-2fe68e204ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:39Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Creating volume 55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:39 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:39 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 1073741824 Sep 11 23:18:39 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:40 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 1073741824" returned: 0 in 0.527s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:40 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 Sep 11 23:18:40 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:40 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" returned: 0 in 0.254s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ffbcc5-fe83-484c-a1a6-d547fb3bb204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21197850-0753-4fd9-b05f-affd27f4b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:40 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Volume volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 (55d0bfbe-f536-4c69-aa7c-2fe68e204ef4): created successfully Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21197850-0753-4fd9-b05f-affd27f4b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:40 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (caab1988-b7ec-4a18-b4f5-6b54c078ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:40 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d8af2f29-359a-4d27-8aa2-bb7fd47ae362 tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Flow 'volume_create_manager' (15ddae4d-c8d6-40c1-93c1-214a803d0225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b1c6fe-a705-40b1-9e23-fcdd2a815c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b1c6fe-a705-40b1-9e23-fcdd2a815c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe319f63-c778-408d-bb60-f4bccc968914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13d272e973c4570861ea17769246688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:41Z,use_quota=True,user_id='b549a25f817e48a491c5197d044210bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2821b869-b364-4bfb-99d4-25759936e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2821b869-b364-4bfb-99d4-25759936e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28b63bf-ac92-4020-a113-48deb1f0ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28b63bf-ac92-4020-a113-48deb1f0ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe319f63-c778-408d-bb60-f4bccc968914', 'volume_name': 'volume-fe319f63-c778-408d-bb60-f4bccc968914', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f03cdb-dbaa-4b71-8116-2c15a903d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f03cdb-dbaa-4b71-8116-2c15a903d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fbca2f-8ed6-4299-b5dc-6fa1c6edd852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:41 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Volume fe319f63-c778-408d-bb60-f4bccc968914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe319f63-c778-408d-bb60-f4bccc968914', 'volume_size': 1} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe319f63-c778-408d-bb60-f4bccc968914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13d272e973c4570861ea17769246688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:41Z,use_quota=True,user_id='b549a25f817e48a491c5197d044210bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Creating volume fe319f63-c778-408d-bb60-f4bccc968914 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:41 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:41 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 1073741824 Sep 11 23:18:41 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:41 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 1073741824" returned: 0 in 0.528s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:41 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 Sep 11 23:18:41 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:42 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fbca2f-8ed6-4299-b5dc-6fa1c6edd852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe319f63-c778-408d-bb60-f4bccc968914', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0e33b6-59cd-4a66-ab57-74d361f9c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:42 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Volume volume-fe319f63-c778-408d-bb60-f4bccc968914 (fe319f63-c778-408d-bb60-f4bccc968914): created successfully Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0e33b6-59cd-4a66-ab57-74d361f9c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Flow 'volume_create_manager' (15ddae4d-c8d6-40c1-93c1-214a803d0225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Creating offline snapshot 3d7956f8-7819-437d-92b4-58e980f8a546 of volume 55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:18:42 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9ecaca45-0cf9-4609-a5bc-daeb5bde71e1 tempest-CinderUnicodeTest-1465940153 None] Created volume successfully. Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac311d-06bc-4ea3-9891-535f9b6e4935]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:42 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 Sep 11 23:18:42 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:42 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" returned: 0 in 0.413s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:42 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 1G Sep 11 23:18:42 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:43 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 1G" returned: 0 in 0.470s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:43 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 Sep 11 23:18:43 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:43 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546" returned: 0 in 0.415s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:43 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 is being set with open permissions: ugo+rw Sep 11 23:18:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:43 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 Sep 11 23:18:43 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:43 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:44 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info Sep 11 23:18:44 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Flow 'volume_create_manager' (88921f32-abda-4a3b-b200-2a49b987726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158dc75c-2c89-4fa8-b30d-4da49e621ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158dc75c-2c89-4fa8-b30d-4da49e621ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1963582850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f992bfb-339d-4551-91f8-51420db01a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13d272e973c4570861ea17769246688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:44Z,use_quota=True,user_id='b549a25f817e48a491c5197d044210bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efba2724-33dd-4d32-b45b-2e8f501d1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efba2724-33dd-4d32-b45b-2e8f501d1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691c931c-c127-4222-9496-a0e473040dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691c931c-c127-4222-9496-a0e473040dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f992bfb-339d-4551-91f8-51420db01a75', 'volume_name': 'volume-5f992bfb-339d-4551-91f8-51420db01a75', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7303f11e-a155-422a-abe4-e1df41f01786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7303f11e-a155-422a-abe4-e1df41f01786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8906e5-90d3-4f46-a264-d49c5e042c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:44 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Volume 5f992bfb-339d-4551-91f8-51420db01a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f992bfb-339d-4551-91f8-51420db01a75', 'volume_size': 1} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:44 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info" returned: 0 in 0.296s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:44 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info is being set with open permissions: ugo+rw Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:44 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info Sep 11 23:18:44 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:44 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.info" returned: 0 in 0.253s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1963582850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f992bfb-339d-4551-91f8-51420db01a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13d272e973c4570861ea17769246688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:44Z,use_quota=True,user_id='b549a25f817e48a491c5197d044210bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Creating volume 5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:44 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:44 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 1073741824 Sep 11 23:18:44 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4781e49c-7088-4a5b-a622-0a7d2021c20c tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:18:45 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 1073741824" returned: 0 in 0.511s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:45 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 Sep 11 23:18:45 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-3d7956f8-7819-437d-92b4-58e980f8a546-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Lock "cinder-3d7956f8-7819-437d-92b4-58e980f8a546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:45 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75" returned: 0 in 0.293s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8906e5-90d3-4f46-a264-d49c5e042c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f992bfb-339d-4551-91f8-51420db01a75', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45802d5b-b26e-4b57-9da5-77ee59777f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-3d7956f8-7819-437d-92b4-58e980f8a546" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:45 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Volume volume-5f992bfb-339d-4551-91f8-51420db01a75 (5f992bfb-339d-4551-91f8-51420db01a75): created successfully Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45802d5b-b26e-4b57-9da5-77ee59777f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Flow 'volume_create_manager' (88921f32-abda-4a3b-b200-2a49b987726a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3d7956f8-7819-437d-92b4-58e980f8a546" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot 3d7956f8-7819-437d-92b4-58e980f8a546 of volume 55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c460b7-455e-4c50-9606-7b47edeaca18]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:45 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9fc19579-0cc3-4f4d-a672-e429c8d7459c tempest-CinderUnicodeTest-1465940153 None] Created volume successfully. Sep 11 23:18:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:45 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 Sep 11 23:18:45 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:46 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546" returned: 0 in 0.463s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f08a1a3-8675-4629-af91-7041130a453f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:46 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 Sep 11 23:18:46 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=195,cinder:UPDATE=239,cinder:DELETE=26,cinder:INSERT=68 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Creating offline snapshot e0f9f61d-488a-4e4c-910c-d821ac27d994 of volume 5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a8396-1b26-4473-9f2b-d266189d453a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:46 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" returned: 0 in 0.487s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:46 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 Sep 11 23:18:46 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:46 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 Sep 11 23:18:46 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:47 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75" returned: 0 in 0.464s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:47 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 1G Sep 11 23:18:47 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:47 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546" returned: 0 in 0.456s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:47 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546 Sep 11 23:18:47 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:47 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4.3d7956f8-7819-437d-92b4-58e980f8a546" returned: 0 in 0.337s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3d7956f8-7819-437d-92b4-58e980f8a546" released by "_delete_snapshot" :: held 1.922s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" released by "delete_snapshot" :: held 1.986s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:UPDATE=280,cinder:SELECT=184,cinder:INSERT=70,cinder:DELETE=22 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Created reservations ['a3c15690-51fa-4cdf-9b3b-278c5f2ec6c6', '88c30f03-df17-4c69-9848-e44a92cc46d7', 'e1a70b95-9756-48e8-8aa6-4375b88d770d', '9e162d7c-651c-42ea-b999-a910fa85ef6e'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:47 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 1G" returned: 0 in 0.564s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f992bfb-339d-4551-91f8-51420db01a75 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:47 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f992bfb-339d-4551-91f8-51420db01a75 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 Sep 11 23:18:47 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-87279f66-d7a5-482b-adbd-b899fc07325e tempest-ProjectMemberTests-842029992 None] Lock "cinder-3d7956f8-7819-437d-92b4-58e980f8a546-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:47 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f992bfb-339d-4551-91f8-51420db01a75 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 is being set with open permissions: ugo+rw Sep 11 23:18:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:47 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 Sep 11 23:18:47 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:48 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:48 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info Sep 11 23:18:48 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:48 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info" returned: 0 in 0.296s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:48 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info is being set with open permissions: ugo+rw Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:48 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info Sep 11 23:18:48 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Lock "cinder-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:48 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.info" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a7bd7-b827-43dd-a581-900190c266eb]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e2d713e5-9b33-4ffe-80a3-296701237748 tempest-CinderUnicodeTest-1465940153 None] Create snapshot completed successfully Sep 11 23:18:49 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 Sep 11 23:18:49 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:49 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" returned: 0 in 0.420s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:49 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4 Sep 11 23:18:49 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-e0f9f61d-488a-4e4c-910c-d821ac27d994-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:49 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-e0f9f61d-488a-4e4c-910c-d821ac27d994-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-quobyte-5f992bfb-339d-4551-91f8-51420db01a75" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" returned: 0 in 0.409s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-5f992bfb-339d-4551-91f8-51420db01a75" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-quobyte-e0f9f61d-488a-4e4c-910c-d821ac27d994" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4" released by "delete_volume" :: held 0.922s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-e0f9f61d-488a-4e4c-910c-d821ac27d994" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Deleting offline snapshot e0f9f61d-488a-4e4c-910c-d821ac27d994 of volume 5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] snapshot_file for this snap is: volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[462fb8c9-8032-42e3-a223-e61a93d52e51]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:49 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Created reservations ['0ebcc03e-0619-4b81-8f6b-23cb28f820a0', '1edb45fc-7e25-420b-8336-1ec395d51677', '584d650d-97df-4683-a6fd-fab75d51e068', '5ea07bb5-93ad-48ad-9bc9-f789f5f6495c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:50 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 Sep 11 23:18:50 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:50 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:50 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:50 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.287s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:50 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:18:50 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994" returned: 0 in 0.457s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f992bfb-339d-4551-91f8-51420db01a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d51a2d4e-9475-49e7-ab91-919e58e70720 tempest-ProjectMemberTests-842029992 None] Lock "cinder-55d0bfbe-f536-4c69-aa7c-2fe68e204ef4-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a86350-2ab2-416e-ada2-26067adaae03]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:50 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 Sep 11 23:18:50 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:50 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75" returned: 0 in 0.383s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:50 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 Sep 11 23:18:50 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:51 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994" returned: 0 in 0.431s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:51 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994 Sep 11 23:18:51 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:51 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75.e0f9f61d-488a-4e4c-910c-d821ac27d994" returned: 0 in 0.400s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-e0f9f61d-488a-4e4c-910c-d821ac27d994" released by "_delete_snapshot" :: held 1.841s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-5f992bfb-339d-4551-91f8-51420db01a75" released by "delete_snapshot" :: held 1.882s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (e6990586-e6e3-46e0-b710-985974fbe1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f5c0f3-8df1-4021-a05b-e772ca243458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f5c0f3-8df1-4021-a05b-e772ca243458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127207940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:52Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da034ee7-b40f-4b3c-90a1-6b4a06453072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da034ee7-b40f-4b3c-90a1-6b4a06453072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f153172-71d9-4e8b-ad28-e01fc367d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f153172-71d9-4e8b-ad28-e01fc367d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4', 'volume_name': 'volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b71dee-db3e-4c77-88cd-4344a2576f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b71dee-db3e-4c77-88cd-4344a2576f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32266a53-007f-47c4-b7c5-324af1c458c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Volume ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4', 'volume_size': 1} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127207940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:52Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Creating volume ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:51 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:51 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 1073741824 Sep 11 23:18:51 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:51 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Created reservations ['8d75b239-db31-4da4-a5cb-1ff7e2c96d39', 'fd2a0445-41e2-4c7e-ab95-8b96b39830c8', 'bea6d300-332b-4370-b2bb-76ecbee5f4d1', '5899c2de-4279-4f3e-8028-c357e6266e32'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Delete snapshot completed successfully. Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9229f57f-82f1-422c-ace8-f960c9367381 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-e0f9f61d-488a-4e4c-910c-d821ac27d994-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:52 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 1073741824" returned: 0 in 0.574s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:52 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 Sep 11 23:18:52 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:52 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32266a53-007f-47c4-b7c5-324af1c458c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ece21c-fc98-4de0-a10c-d0a7089d9274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:52 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Volume volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 (ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4): created successfully Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ece21c-fc98-4de0-a10c-d0a7089d9274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:52 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (e6990586-e6e3-46e0-b710-985974fbe1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:52 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8d0825b8-af71-4b2b-ab9c-1b9eea0354be tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-5f992bfb-339d-4551-91f8-51420db01a75-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-5f992bfb-339d-4551-91f8-51420db01a75-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-quobyte-5f992bfb-339d-4551-91f8-51420db01a75" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-5f992bfb-339d-4551-91f8-51420db01a75" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d7ab7-766a-4632-b84a-146d47828a13]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:53 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 Sep 11 23:18:53 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:53 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75" returned: 0 in 0.435s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:53 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75 Sep 11 23:18:53 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:53 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-5f992bfb-339d-4551-91f8-51420db01a75" returned: 0 in 0.354s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:53 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-5f992bfb-339d-4551-91f8-51420db01a75" released by "delete_volume" :: held 0.865s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Created reservations ['ca85c518-de87-4961-8b36-95f2a0cd643f', '5a91d1b8-06a7-4320-8231-eb0d9feaccab', '157d6a65-36ae-4e15-bf3b-d0709ad22f6c', '3c9260cb-48fe-45a8-a22d-47e3f3ca7d14'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot 963c5b20-cf6e-477b-881e-d0c941995066 of volume ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c17ebf-ef99-4860-abe7-38736885215b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-fe319f63-c778-408d-bb60-f4bccc968914-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:54 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:54 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:54 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 Sep 11 23:18:54 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-fe319f63-c778-408d-bb60-f4bccc968914-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "cinder-quobyte-fe319f63-c778-408d-bb60-f4bccc968914" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-fe319f63-c778-408d-bb60-f4bccc968914" acquired by "delete_volume" :: waited 0.031s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[899a7ea8-5c14-443c-9356-fcbb3ff72c41]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:54 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" returned: 0 in 0.518s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:54 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 Sep 11 23:18:54 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:54 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.471s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:54 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 1G Sep 11 23:18:54 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:54 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Deleted volume successfully. Sep 11 23:18:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f61d1e6f-4c2c-4171-b381-9c8ead4417d5 tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-5f992bfb-339d-4551-91f8-51420db01a75-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (941635f7-cf71-4e5f-afe3-3441e9e54b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb53d0cc-480a-44a6-b6a4-1d65a9902374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb53d0cc-480a-44a6-b6a4-1d65a9902374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856717456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88f50c-6bb3-492c-bbc2-e7f92946f384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:55Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f47153-1be1-455c-86a7-e77a5124b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:55 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f47153-1be1-455c-86a7-e77a5124b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6888796-bf61-47fa-bd56-7a2d29e4a2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6888796-bf61-47fa-bd56-7a2d29e4a2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d88f50c-6bb3-492c-bbc2-e7f92946f384', 'volume_name': 'volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14800ee9-af33-4280-8d7f-fa42e5a14c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14800ee9-af33-4280-8d7f-fa42e5a14c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fc89b3-a463-434d-b46d-de27943d3b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:55 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Volume 1d88f50c-6bb3-492c-bbc2-e7f92946f384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384', 'volume_size': 1} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914" returned: 0 in 0.705s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:55 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914 Sep 11 23:18:55 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:55 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 1G" returned: 0 in 0.817s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:55 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 Sep 11 23:18:55 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:55 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-fe319f63-c778-408d-bb60-f4bccc968914" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-quobyte-fe319f63-c778-408d-bb60-f4bccc968914" released by "delete_volume" :: held 1.154s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Created reservations ['ea66d7e0-4030-4ad3-867c-67c8bbe016f5', 'ccac3f49-aece-4e2c-a40e-eb1ab62ea4ad', '3c55a8bf-3034-45bc-848e-80ae88fde650', '6388ac2d-2198-4ea9-9b84-08c6b0ebc66f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:55 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066" returned: 0 in 0.454s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:55 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 is being set with open permissions: ugo+rw Sep 11 23:18:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:55 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:55 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:56 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 Sep 11 23:18:56 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:56 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.358s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:56 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Deleted volume successfully. Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33e3ca0c-50b5-4526-806c-5fe62057be9f tempest-CinderUnicodeTest-1465940153 None] Lock "cinder-fe319f63-c778-408d-bb60-f4bccc968914-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:56 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:56 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info Sep 11 23:18:56 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:56 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info" returned: 0 in 0.337s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:56 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info is being set with open permissions: ugo+rw Sep 11 23:18:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:56 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info Sep 11 23:18:56 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:57 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.info" returned: 0 in 0.305s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856717456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88f50c-6bb3-492c-bbc2-e7f92946f384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:55Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Creating volume 1d88f50c-6bb3-492c-bbc2-e7f92946f384 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:57 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:57 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 1073741824 Sep 11 23:18:57 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-792e8a68-62c6-49d1-987e-56a40726bf68 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-963c5b20-cf6e-477b-881e-d0c941995066-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Lock "cinder-963c5b20-cf6e-477b-881e-d0c941995066-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-963c5b20-cf6e-477b-881e-d0c941995066" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-963c5b20-cf6e-477b-881e-d0c941995066" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot 963c5b20-cf6e-477b-881e-d0c941995066 of volume ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c851ae69-c770-4c47-9c2f-625c79a6bd37]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:57 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 Sep 11 23:18:57 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:57 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 1073741824" returned: 0 in 0.714s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:57 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 Sep 11 23:18:57 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:57 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066" returned: 0 in 0.545s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd8ab3-e117-4a70-906d-1c69c50e4ac0]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:58 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 Sep 11 23:18:58 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:58 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384" returned: 0 in 0.421s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fc89b3-a463-434d-b46d-de27943d3b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1839b5ee-ef33-4109-a0d8-9abd1a252192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Volume volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 (1d88f50c-6bb3-492c-bbc2-e7f92946f384): created successfully Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1839b5ee-ef33-4109-a0d8-9abd1a252192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (941635f7-cf71-4e5f-afe3-3441e9e54b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-b48c678f-e075-4f28-af10-d4d1b4ba582b tempest-ProjectReaderTests-725296651 None] Created volume successfully. Sep 11 23:18:58 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" returned: 0 in 0.566s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:58 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 Sep 11 23:18:58 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:59 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066" returned: 0 in 0.415s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:59 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066 Sep 11 23:18:59 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:59 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:18:59 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:59 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4.963c5b20-cf6e-477b-881e-d0c941995066" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:59 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-963c5b20-cf6e-477b-881e-d0c941995066" released by "_delete_snapshot" :: held 2.168s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" released by "delete_snapshot" :: held 2.204s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Created reservations ['7a81537a-4fb6-4f46-98fd-01cb2da2b536', 'b18d45cc-08c2-445f-baf8-578e36dafc26', '96518e22-ae4c-4bef-b7a7-7447ca4ba60e', '698a5da6-b0b5-4fbe-bbfc-e05c2384813c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:59 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-445de0d5-7ce9-4788-8543-ac323804747b tempest-ProjectMemberTests-842029992 None] Lock "cinder-963c5b20-cf6e-477b-881e-d0c941995066-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-1d88f50c-6bb3-492c-bbc2-e7f92946f384-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Lock "cinder-1d88f50c-6bb3-492c-bbc2-e7f92946f384-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-quobyte-1d88f50c-6bb3-492c-bbc2-e7f92946f384" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:59 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-1d88f50c-6bb3-492c-bbc2-e7f92946f384" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5573b2-3124-4429-b676-5439a3f842dc]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:00 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 Sep 11 23:19:00 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384" returned: 0 in 0.511s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:00 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:00 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384 Sep 11 23:19:00 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Lock "cinder-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" acquired by "delete_volume" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:00 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1d88f50c-6bb3-492c-bbc2-e7f92946f384" returned: 0 in 0.360s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[82725364-22ae-41bf-ad9a-91839a39caee]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-1d88f50c-6bb3-492c-bbc2-e7f92946f384" released by "delete_volume" :: held 0.928s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:00 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Created reservations ['20125753-25bd-460e-9ffc-82b4bc505ad4', '4ea4880e-ab07-48a3-84f3-64ba5c1fd827', 'bd1c7227-d424-4751-857e-52691eb48bea', '9c538fc3-c37b-4fbf-9ad3-11e973e60ded'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:01 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 Sep 11 23:19:01 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:01 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:01 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:01 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" returned: 0 in 0.509s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:01 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4 Sep 11 23:19:01 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:01 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.410s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:01 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Deleted volume successfully. Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-dd07005c-5ccb-4b2b-b0bf-8be1c074c599 tempest-ProjectReaderTests-725296651 None] Lock "cinder-1d88f50c-6bb3-492c-bbc2-e7f92946f384-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-b0a72406-43b1-4995-8c4a-ba9c01afcb02 tempest-ProjectAdminTests-840498658 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88002) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 23:19:01 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4" released by "delete_volume" :: held 0.948s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:01 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Created reservations ['2392a137-e9cb-4b54-9e8b-d7f2a7291985', '340c122c-0484-4151-a350-e885023cb7a5', '93e5e2f8-d914-4db0-bdb9-55cea05d90cf', 'd40ec277-95ed-4513-b626-13abc4456499'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (25f6d50e-a751-493f-9d0d-407270dce08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:02 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:02 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d97838-8d2c-404c-a6f3-3aa9fe10e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d97838-8d2c-404c-a6f3-3aa9fe10e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497948993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a9f5bf-f452-4e0b-b751-7338847a36f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:02Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afdf2f4-2a31-4e53-a9a4-1fbcd99b38a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afdf2f4-2a31-4e53-a9a4-1fbcd99b38a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb43a5fb-1f75-4763-ad92-8726433235ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb43a5fb-1f75-4763-ad92-8726433235ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a9f5bf-f452-4e0b-b751-7338847a36f1', 'volume_name': 'volume-07a9f5bf-f452-4e0b-b751-7338847a36f1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb496dc7-1c1d-4c41-9172-36f9dde427fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb496dc7-1c1d-4c41-9172-36f9dde427fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155aa085-a5c4-49c9-a0e5-30add7a8005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Volume 07a9f5bf-f452-4e0b-b751-7338847a36f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a9f5bf-f452-4e0b-b751-7338847a36f1', 'volume_size': 1} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497948993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a9f5bf-f452-4e0b-b751-7338847a36f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:02Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Creating volume 07a9f5bf-f452-4e0b-b751-7338847a36f1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:02 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:02 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 1073741824 Sep 11 23:19:02 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:02 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.453s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-313ebe74-1980-4e86-a6de-8cea8fc6ddd0 tempest-ProjectMemberTests-842029992 None] Lock "cinder-ea9253b9-3c29-4ad7-b9d2-b5c5a6a4d6d4-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (057bce3d-300d-4784-9337-8cf9f89d9716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e32a5f9-bf1b-4ace-a466-d3989c164898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e32a5f9-bf1b-4ace-a466-d3989c164898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444843089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a90413e-0e23-4431-9200-4ce66f5f9d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:03Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a5f319-3195-4e67-a731-29c9d4499740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a5f319-3195-4e67-a731-29c9d4499740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37317983-3843-455a-9ebe-df6abdad76b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37317983-3843-455a-9ebe-df6abdad76b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a90413e-0e23-4431-9200-4ce66f5f9d0a', 'volume_name': 'volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5aeecd-d24b-4fed-b71a-553cfadd4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5aeecd-d24b-4fed-b71a-553cfadd4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bdb6c6-da48-489f-a218-b4876fa43a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:02 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Volume 6a90413e-0e23-4431-9200-4ce66f5f9d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a', 'volume_size': 1} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 1073741824" returned: 0 in 0.717s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:02 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 Sep 11 23:19:02 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:03 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1" returned: 0 in 0.257s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444843089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a90413e-0e23-4431-9200-4ce66f5f9d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:03Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Creating volume 6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:03 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155aa085-a5c4-49c9-a0e5-30add7a8005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a9f5bf-f452-4e0b-b751-7338847a36f1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639e53ad-a631-416a-a566-48ad81777dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:03 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a 1073741824 Sep 11 23:19:03 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:03 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Volume volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 (07a9f5bf-f452-4e0b-b751-7338847a36f1): created successfully Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639e53ad-a631-416a-a566-48ad81777dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (25f6d50e-a751-493f-9d0d-407270dce08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:03 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f9c59945-e331-40cc-aba0-319fac07cdda tempest-ProjectReaderTests-725296651 None] Created volume successfully. Sep 11 23:19:03 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a 1073741824" returned: 0 in 0.582s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:03 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a Sep 11 23:19:03 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-07a9f5bf-f452-4e0b-b751-7338847a36f1-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Lock "cinder-07a9f5bf-f452-4e0b-b751-7338847a36f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-quobyte-07a9f5bf-f452-4e0b-b751-7338847a36f1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-07a9f5bf-f452-4e0b-b751-7338847a36f1" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e4f81c-fb64-4039-81aa-3798d12823a7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:04 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bdb6c6-da48-489f-a218-b4876fa43a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47447c84-b4ef-4dba-a72a-c7d6187926bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:04 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Volume volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a (6a90413e-0e23-4431-9200-4ce66f5f9d0a): created successfully Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47447c84-b4ef-4dba-a72a-c7d6187926bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (057bce3d-300d-4784-9337-8cf9f89d9716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:04 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 Sep 11 23:19:04 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-65d8872f-9e73-4a7b-8a1c-5072e80d33a8 tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:04 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1" returned: 0 in 0.442s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:04 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1 Sep 11 23:19:04 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:04 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-07a9f5bf-f452-4e0b-b751-7338847a36f1" returned: 0 in 0.335s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-07a9f5bf-f452-4e0b-b751-7338847a36f1" released by "delete_volume" :: held 0.845s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot bb216aeb-517e-493e-a47e-c07434cd6a72 of volume 6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6e776f-be4d-45b4-9541-27bde77eb125]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Created reservations ['23836c11-c6c7-4399-bfa3-2e66df1d672c', 'b2ac9640-9275-412c-bf08-6f6d4d5fd911', '1dc5b8b1-e455-4893-b5ef-2c6d585815b6', '3ce51d75-4425-4bd1-ac99-06560804a16d'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:05 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:05 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:05 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a Sep 11 23:19:05 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:05 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.352s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:05 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Deleted volume successfully. Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-eecc4e8a-0303-44ff-a26a-d35762fc3272 tempest-ProjectReaderTests-725296651 None] Lock "cinder-07a9f5bf-f452-4e0b-b751-7338847a36f1-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:05 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a" returned: 0 in 0.709s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:05 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 1G Sep 11 23:19:05 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:05 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (4d167ce8-6efe-4766-934f-b28bc4e2d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7db3c5-2911-49f8-a57f-4df5a62b3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7db3c5-2911-49f8-a57f-4df5a62b3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892816870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef8da94-4f8d-4e95-8fd3-3dc990096a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:06Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee6f643-c785-41cb-b024-77fdb3dde588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee6f643-c785-41cb-b024-77fdb3dde588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226beb7a-e405-4b69-8827-235ffb91bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226beb7a-e405-4b69-8827-235ffb91bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef8da94-4f8d-4e95-8fd3-3dc990096a59', 'volume_name': 'volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4409e2-9d15-43d1-b2c5-bd36471d8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4409e2-9d15-43d1-b2c5-bd36471d8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d7e680-3eb7-4418-8d4f-6c86fe022233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:06 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Volume 2ef8da94-4f8d-4e95-8fd3-3dc990096a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59', 'volume_size': 1} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:06 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 1G" returned: 0 in 0.551s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:06 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 Sep 11 23:19:06 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:06 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:06 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 is being set with open permissions: ugo+rw Sep 11 23:19:06 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:06 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 Sep 11 23:19:06 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:06 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72" returned: 0 in 0.375s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:07 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info Sep 11 23:19:07 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:07 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info" returned: 0 in 0.259s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:07 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info is being set with open permissions: ugo+rw Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:07 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info Sep 11 23:19:07 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:07 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.info" returned: 0 in 0.325s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.703s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892816870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef8da94-4f8d-4e95-8fd3-3dc990096a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:06Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Creating volume 2ef8da94-4f8d-4e95-8fd3-3dc990096a59 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:07 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:07 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:07 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 1073741824 Sep 11 23:19:07 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:07 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4cefe606-41f3-4b85-a8dd-5747cf04ff19 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-bb216aeb-517e-493e-a47e-c07434cd6a72-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Lock "cinder-bb216aeb-517e-493e-a47e-c07434cd6a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-6a90413e-0e23-4431-9200-4ce66f5f9d0a" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:08 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 1073741824" returned: 0 in 0.605s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-6a90413e-0e23-4431-9200-4ce66f5f9d0a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-bb216aeb-517e-493e-a47e-c07434cd6a72" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-bb216aeb-517e-493e-a47e-c07434cd6a72" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot bb216aeb-517e-493e-a47e-c07434cd6a72 of volume 6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbddaa31-34af-4765-9d97-90ce65029e23]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:08 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 Sep 11 23:19:08 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:08 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 Sep 11 23:19:08 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:08 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59" returned: 0 in 0.460s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d7e680-3eb7-4418-8d4f-6c86fe022233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63c38a2-2a70-4b36-8b1f-553a9c4f032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Volume volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 (2ef8da94-4f8d-4e95-8fd3-3dc990096a59): created successfully Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63c38a2-2a70-4b36-8b1f-553a9c4f032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (4d167ce8-6efe-4766-934f-b28bc4e2d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-4b2be47b-d65d-4903-8f7f-c0d89879ba2b tempest-ProjectReaderTests-725296651 None] Created volume successfully. Sep 11 23:19:09 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72" returned: 0 in 0.665s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c0304-a031-4f4f-8a27-b89c9abab98b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:09 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a Sep 11 23:19:09 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-2ef8da94-4f8d-4e95-8fd3-3dc990096a59-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Lock "cinder-2ef8da94-4f8d-4e95-8fd3-3dc990096a59-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-quobyte-2ef8da94-4f8d-4e95-8fd3-3dc990096a59" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-2ef8da94-4f8d-4e95-8fd3-3dc990096a59" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab36a9cb-f146-4a30-bb5f-f9b6e3645624]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:09 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a" returned: 0 in 0.568s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:09 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 Sep 11 23:19:09 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:09 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 Sep 11 23:19:09 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:10 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59" returned: 0 in 0.516s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:10 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59 Sep 11 23:19:10 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:10 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72" returned: 0 in 0.589s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:10 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72 Sep 11 23:19:10 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:10 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-2ef8da94-4f8d-4e95-8fd3-3dc990096a59" returned: 0 in 0.418s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-2ef8da94-4f8d-4e95-8fd3-3dc990096a59" released by "delete_volume" :: held 1.004s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Created reservations ['4f547f4e-dcf1-4322-a37d-75249c6bb86c', '64f2c2e3-e737-41af-b8a9-5548d9b0e8c4', '7e6705f5-39ae-4ecc-8f87-d351173e9b46', '7f290248-a7c6-441f-a1dc-68e8a4c2b08f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:10 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a.bb216aeb-517e-493e-a47e-c07434cd6a72" returned: 0 in 0.398s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-bb216aeb-517e-493e-a47e-c07434cd6a72" released by "_delete_snapshot" :: held 2.388s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-6a90413e-0e23-4431-9200-4ce66f5f9d0a" released by "delete_snapshot" :: held 2.433s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:10 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:10 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Created reservations ['f90e242d-82c4-4c03-b5ec-a7f43a669307', 'a6955644-7ee9-48fd-967f-794ab5b4bb45', '1d6e112a-f28b-4299-bf64-86d8b8f62fb9', 'ec59bbf7-cc48-41f8-8c37-1117c6b617c3'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:19:10 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d8f02216-6986-45c0-b1eb-40bfd3dbb4bd tempest-ProjectMemberTests-842029992 None] Lock "cinder-bb216aeb-517e-493e-a47e-c07434cd6a72-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:11 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.369s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:11 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Deleted volume successfully. Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-cfeac7c3-de23-45d1-86c1-8a94791277e6 tempest-ProjectReaderTests-725296651 None] Lock "cinder-2ef8da94-4f8d-4e95-8fd3-3dc990096a59-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-6a90413e-0e23-4431-9200-4ce66f5f9d0a-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Lock "cinder-6a90413e-0e23-4431-9200-4ce66f5f9d0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-6a90413e-0e23-4431-9200-4ce66f5f9d0a" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-6a90413e-0e23-4431-9200-4ce66f5f9d0a" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21bd984-400f-4612-812a-f9c12b9e0e9a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:11 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a Sep 11 23:19:11 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:12 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a" returned: 0 in 0.472s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:12 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a Sep 11 23:19:12 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (93550679-5b42-4e26-89fe-8befdff3a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acab508-7fe1-409c-9d8a-8fbbe11a69ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acab508-7fe1-409c-9d8a-8fbbe11a69ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325813291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb18320-2a31-4c63-9a17-fb1088d488ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e14d6f-d01c-4532-be1d-242ad0a3fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e14d6f-d01c-4532-be1d-242ad0a3fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c17afea-c38f-4186-86df-0930db39f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c17afea-c38f-4186-86df-0930db39f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb18320-2a31-4c63-9a17-fb1088d488ab', 'volume_name': 'volume-3eb18320-2a31-4c63-9a17-fb1088d488ab', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc93663a-d148-4b83-8902-513d88578bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc93663a-d148-4b83-8902-513d88578bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd8665d-65d6-4248-b49c-06d4180e580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Volume 3eb18320-2a31-4c63-9a17-fb1088d488ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb18320-2a31-4c63-9a17-fb1088d488ab', 'volume_size': 1} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325813291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb18320-2a31-4c63-9a17-fb1088d488ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13306afe0a1e44b38bb1fbca0db5bcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='72d1093034c042ceb3c43297e54b9db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Creating volume 3eb18320-2a31-4c63-9a17-fb1088d488ab {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:12 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-6a90413e-0e23-4431-9200-4ce66f5f9d0a" returned: 0 in 0.484s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-6a90413e-0e23-4431-9200-4ce66f5f9d0a" released by "delete_volume" :: held 1.029s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:12 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab 1073741824 Sep 11 23:19:12 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Created reservations ['ce0f8ed7-b86f-45e8-bf65-cb3991d18063', '2dac3261-19ee-44a0-bb07-0f1fb7125e00', '15b36d0e-ecbd-4c04-8fce-1fa0588af623', '9a77c722-00bd-401d-8721-0601961293ca'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:12 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:12 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:13 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab 1073741824" returned: 0 in 0.699s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:13 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.424s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:13 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab Sep 11 23:19:13 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7d7ca91b-a200-4c9e-a096-143ddab65fcc tempest-ProjectMemberTests-842029992 None] Lock "cinder-6a90413e-0e23-4431-9200-4ce66f5f9d0a-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:13 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd8665d-65d6-4248-b49c-06d4180e580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb18320-2a31-4c63-9a17-fb1088d488ab', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70211c5b-e075-4fe0-9d88-799aa9a88702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Volume volume-3eb18320-2a31-4c63-9a17-fb1088d488ab (3eb18320-2a31-4c63-9a17-fb1088d488ab): created successfully Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70211c5b-e075-4fe0-9d88-799aa9a88702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Flow 'volume_create_manager' (93550679-5b42-4e26-89fe-8befdff3a68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:13 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d9b4a3b6-1a6a-4400-b433-7380e916c485 tempest-ProjectReaderTests-725296651 None] Created volume successfully. Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Flow 'volume_create_manager' (f3563c32-5111-42dd-9268-3ed488ab7414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb3c92d-e294-4b8e-9c7e-9b6bdb62c3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb3c92d-e294-4b8e-9c7e-9b6bdb62c3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1583615511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0643afb9-5ec3-4409-81a1-0710cb5e65e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471afa40aacd43ffa0b02925547e183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:14Z,use_quota=True,user_id='1d835ebaf0094ce095c244a769e2b325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d007ba15-cb7e-40b4-902f-fe1f105038c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d007ba15-cb7e-40b4-902f-fe1f105038c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f27bbf6-ef3c-4c4c-bd03-25662d6c7b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f27bbf6-ef3c-4c4c-bd03-25662d6c7b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0643afb9-5ec3-4409-81a1-0710cb5e65e1', 'volume_name': 'volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff00d82-f18e-442b-bcab-c71c681903e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff00d82-f18e-442b-bcab-c71c681903e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1296b9a9-7fa8-4486-a495-c53ac90f00ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Volume 0643afb9-5ec3-4409-81a1-0710cb5e65e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1', 'volume_size': 1} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1583615511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0643afb9-5ec3-4409-81a1-0710cb5e65e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471afa40aacd43ffa0b02925547e183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:14Z,use_quota=True,user_id='1d835ebaf0094ce095c244a769e2b325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Creating volume 0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:13 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:14 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:14 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 1073741824 Sep 11 23:19:14 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (7947f5ac-51f9-40ba-a070-7332bfccc222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671b5679-1696-48c5-937c-a38975084c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671b5679-1696-48c5-937c-a38975084c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44908317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152525e1-9cc4-4da7-b400-a81d12de95a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:14Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafb0149-b155-41af-b7cc-1ff4dad753e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafb0149-b155-41af-b7cc-1ff4dad753e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff4a986-148a-4e0c-9ac8-7d2c6c51799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff4a986-148a-4e0c-9ac8-7d2c6c51799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152525e1-9cc4-4da7-b400-a81d12de95a1', 'volume_name': 'volume-152525e1-9cc4-4da7-b400-a81d12de95a1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29734732-09d8-4c31-9b55-324215ccdeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29734732-09d8-4c31-9b55-324215ccdeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f847694a-a419-46eb-80e2-e0accc33f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Volume 152525e1-9cc4-4da7-b400-a81d12de95a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152525e1-9cc4-4da7-b400-a81d12de95a1', 'volume_size': 1} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-3eb18320-2a31-4c63-9a17-fb1088d488ab-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Lock "cinder-3eb18320-2a31-4c63-9a17-fb1088d488ab-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Acquiring lock "cinder-quobyte-3eb18320-2a31-4c63-9a17-fb1088d488ab" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-3eb18320-2a31-4c63-9a17-fb1088d488ab" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db6c57-cb44-4f93-b905-67e4267c9739]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:14 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 1073741824" returned: 0 in 0.739s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:14 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 Sep 11 23:19:14 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:14 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab Sep 11 23:19:14 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44908317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152525e1-9cc4-4da7-b400-a81d12de95a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:14Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Creating volume 152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:15 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1296b9a9-7fa8-4486-a495-c53ac90f00ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 1073741824 Sep 11 23:19:15 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01ad2d7-bea7-4381-83e3-f4cb023881ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Volume volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 (0643afb9-5ec3-4409-81a1-0710cb5e65e1): created successfully Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01ad2d7-bea7-4381-83e3-f4cb023881ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Flow 'volume_create_manager' (f3563c32-5111-42dd-9268-3ed488ab7414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab" returned: 0 in 0.470s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-dcf269f8-18ca-4166-ab19-bdf7aa328e1f tempest-SnapshotDependencyTests-1351776231 None] Created volume successfully. Sep 11 23:19:15 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab Sep 11 23:19:15 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3eb18320-2a31-4c63-9a17-fb1088d488ab" returned: 0 in 0.295s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Lock "cinder-quobyte-3eb18320-2a31-4c63-9a17-fb1088d488ab" released by "delete_volume" :: held 0.816s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Created reservations ['92a339d4-3fa4-4708-9ab9-74112d7868f9', '5950c6f0-a7a8-438b-823a-a40ac90b7c32', 'a66a6701-8798-4e0f-91fa-372ce152b100', 'b70dfe13-14be-4da5-838a-90567994480a'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:15 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 1073741824" returned: 0 in 0.504s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 Sep 11 23:19:15 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:15 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.321s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1" returned: 0 in 0.385s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:16 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Deleted volume successfully. Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f847694a-a419-46eb-80e2-e0accc33f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152525e1-9cc4-4da7-b400-a81d12de95a1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607c7397-3a53-4b90-a02c-13714ef9444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Volume volume-152525e1-9cc4-4da7-b400-a81d12de95a1 (152525e1-9cc4-4da7-b400-a81d12de95a1): created successfully Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607c7397-3a53-4b90-a02c-13714ef9444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (7947f5ac-51f9-40ba-a070-7332bfccc222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-57eef312-fe0e-4f79-ba1a-75e82bf3710c tempest-ProjectReaderTests-725296651 None] Lock "cinder-3eb18320-2a31-4c63-9a17-fb1088d488ab-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:16 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-488ab970-1fb5-43d1-be31-4b461e657c9b tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Creating offline snapshot 097d7045-920f-4ccb-bceb-419adaf2fc12 of volume 0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c1211-352a-45d5-8ba0-131b8ff4f195]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 Sep 11 23:19:16 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:16 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1" returned: 0 in 0.463s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 1G Sep 11 23:19:16 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 1G" returned: 0 in 0.507s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 Sep 11 23:19:17 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12" returned: 0 in 0.417s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 is being set with open permissions: ugo+rw Sep 11 23:19:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 Sep 11 23:19:17 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info Sep 11 23:19:18 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info" returned: 0 in 0.258s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info is being set with open permissions: ugo+rw Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info Sep 11 23:19:18 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.info" returned: 0 in 0.280s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.017s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Creating offline snapshot b66f43ee-279a-41b2-b25c-87639fb76d9b of volume 152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-615deaf7-1652-4cad-b21b-717c6b92548c tempest-SnapshotDependencyTests-1351776231 None] Create snapshot completed successfully Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3debf9ff-189a-4495-a3d6-ab66507cbf52]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 Sep 11 23:19:18 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:19 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:19 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b 1G Sep 11 23:19:19 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:19 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b 1G" returned: 0 in 0.486s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152525e1-9cc4-4da7-b400-a81d12de95a1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:19 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152525e1-9cc4-4da7-b400-a81d12de95a1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b Sep 11 23:19:19 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152525e1-9cc4-4da7-b400-a81d12de95a1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b" returned: 0 in 0.394s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b is being set with open permissions: ugo+rw Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b Sep 11 23:19:20 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:20 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b" returned: 0 in 0.306s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Flow 'volume_create_manager' (b4f45f80-5ebe-4d63-969f-76c6e25854ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb36a710-a654-47d5-92c8-fbb4412caf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb36a710-a654-47d5-92c8-fbb4412caf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0ff113-84d0-4158-a970-4fa3a3c631a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471afa40aacd43ffa0b02925547e183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=097d7045-920f-4ccb-bceb-419adaf2fc12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:20Z,use_quota=True,user_id='1d835ebaf0094ce095c244a769e2b325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info Sep 11 23:19:20 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c9ecb-d745-4426-9124-60b0a780f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c9ecb-d745-4426-9124-60b0a780f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dab2b2d-39f3-4618-93e7-b338883c94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dab2b2d-39f3-4618-93e7-b338883c94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf0ff113-84d0-4158-a970-4fa3a3c631a8', 'volume_name': 'volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8', 'volume_size': 1, 'snapshot_id': '097d7045-920f-4ccb-bceb-419adaf2fc12'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c429e27a-3b11-4966-a1af-f6236ae62b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c429e27a-3b11-4966-a1af-f6236ae62b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77332fc-c7d3-4ebe-8db9-fbd6a5072d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Volume bf0ff113-84d0-4158-a970-4fa3a3c631a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8', 'volume_size': 1, 'snapshot_id': '097d7045-920f-4ccb-bceb-419adaf2fc12'} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:20 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info" returned: 0 in 0.261s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:20 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info is being set with open permissions: ugo+rw Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info Sep 11 23:19:20 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.info" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.435s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-quobyte-097d7045-920f-4ccb-bceb-419adaf2fc12-bf0ff113-84d0-4158-a970-4fa3a3c631a8" by "_create_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-097d7045-920f-4ccb-bceb-419adaf2fc12-bf0ff113-84d0-4158-a970-4fa3a3c631a8" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Creating volume bf0ff113-84d0-4158-a970-4fa3a3c631a8 from snapshot 097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-quobyte-bf0ff113-84d0-4158-a970-4fa3a3c631a8" by "_copy_volume_from_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-006fcd90-a543-4b54-9d73-b6cd2e9b705d tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-bf0ff113-84d0-4158-a970-4fa3a3c631a8" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] snapshot: 097d7045-920f-4ccb-bceb-419adaf2fc12, volume: bf0ff113-84d0-4158-a970-4fa3a3c631a8, {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcc89a8-971a-450c-bd87-2b039fb70a14]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 Sep 11 23:19:21 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12" returned: 0 in 0.403s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe7d79-4f10-499e-8f5f-51e6baec230f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 Sep 11 23:19:21 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1" returned: 0 in 0.379s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] will copy from snapshot at /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Creating direct copy from snapshot {{(pid=88002) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG cinder.utils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Path /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 not found in is_blk_device check {{(pid=88002) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:19:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 Sep 11 23:19:21 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-b66f43ee-279a-41b2-b25c-87639fb76d9b-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Lock "cinder-b66f43ee-279a-41b2-b25c-87639fb76d9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-152525e1-9cc4-4da7-b400-a81d12de95a1" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-152525e1-9cc4-4da7-b400-a81d12de95a1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-b66f43ee-279a-41b2-b25c-87639fb76d9b" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-b66f43ee-279a-41b2-b25c-87639fb76d9b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot b66f43ee-279a-41b2-b25c-87639fb76d9b of volume 152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47bc83d-a988-4b0d-8d4a-2d3a5220a6fa]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b Sep 11 23:19:22 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b" returned: 0 in 0.576s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152525e1-9cc4-4da7-b400-a81d12de95a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0f66b7-c5d6-4eb7-8036-b4f107084038]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:23 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 Sep 11 23:19:23 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:24 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1" returned: 0 in 1.264s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:24 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b Sep 11 23:19:24 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:24 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b" returned: 0 in 0.644s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:24 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b Sep 11 23:19:24 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:25 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1.b66f43ee-279a-41b2-b25c-87639fb76d9b" returned: 0 in 0.514s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-b66f43ee-279a-41b2-b25c-87639fb76d9b" released by "_delete_snapshot" :: held 3.223s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-152525e1-9cc4-4da7-b400-a81d12de95a1" released by "delete_snapshot" :: held 3.276s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:25 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Created reservations ['c62f521e-41ad-4fd1-8028-8abe7f30af38', 'aa7a7b92-7468-4ca8-86ea-6183754d7b18', 'bb670523-e0ff-4f5a-8043-9eaf7654e705', '54448f73-7818-4d4a-9f41-579591444716'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:25 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:19:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ea658cdf-c2d1-4222-b5c2-be2872b4a681 tempest-ProjectMemberTests-842029992 None] Lock "cinder-b66f43ee-279a-41b2-b25c-87639fb76d9b-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-152525e1-9cc4-4da7-b400-a81d12de95a1-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-152525e1-9cc4-4da7-b400-a81d12de95a1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-152525e1-9cc4-4da7-b400-a81d12de95a1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-152525e1-9cc4-4da7-b400-a81d12de95a1" acquired by "delete_volume" :: waited 0.036s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:26 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed947a-f20e-4f00-9816-a22f33e9a0db]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8" returned: 0 in 5.358s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.image.image_utils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Image conversion details: src /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 {{(pid=88002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:19:27 devstack cinder-volume[88002]: INFO cinder.image.image_utils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Converted 1024.00 MB image at 191.06 MB/s Sep 11 23:19:27 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 is being set with open permissions: ugo+rw Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 Sep 11 23:19:27 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:27 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 Sep 11 23:19:27 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:27 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8" returned: 0 in 0.248s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-bf0ff113-84d0-4158-a970-4fa3a3c631a8" released by "_copy_volume_from_snapshot" :: held 6.483s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:27 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1" returned: 0 in 0.547s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1 Sep 11 23:19:27 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-097d7045-920f-4ccb-bceb-419adaf2fc12-bf0ff113-84d0-4158-a970-4fa3a3c631a8" released by "_create_volume_from_snapshot" :: held 6.575s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.599s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77332fc-c7d3-4ebe-8db9-fbd6a5072d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8', 'volume_size': 1, 'snapshot_id': '097d7045-920f-4ccb-bceb-419adaf2fc12'}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf502ac1-d280-42b3-a660-44b7e6f21449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:27 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Volume volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 (bf0ff113-84d0-4158-a970-4fa3a3c631a8): created successfully Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf502ac1-d280-42b3-a660-44b7e6f21449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Flow 'volume_create_manager' (b4f45f80-5ebe-4d63-969f-76c6e25854ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3bb25588-5f57-4bab-8e51-5a460033676b tempest-SnapshotDependencyTests-1351776231 None] Created volume successfully. Sep 11 23:19:27 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-152525e1-9cc4-4da7-b400-a81d12de95a1" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-152525e1-9cc4-4da7-b400-a81d12de95a1" released by "delete_volume" :: held 0.911s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Created reservations ['aa8f3566-7389-49bd-bc3f-f7f64be0686f', 'b19d1676-1bcf-4395-9259-8e8a51aaed0c', '4b4e6c4e-b622-496e-9c8a-d680996f11dd', 'ab7690d8-3202-4213-bd5d-8662c2aaa76c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:27 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-097d7045-920f-4ccb-bceb-419adaf2fc12-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-097d7045-920f-4ccb-bceb-419adaf2fc12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-quobyte-0643afb9-5ec3-4409-81a1-0710cb5e65e1" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-0643afb9-5ec3-4409-81a1-0710cb5e65e1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-quobyte-097d7045-920f-4ccb-bceb-419adaf2fc12" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-097d7045-920f-4ccb-bceb-419adaf2fc12" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Deleting offline snapshot 097d7045-920f-4ccb-bceb-419adaf2fc12 of volume 0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] snapshot_file for this snap is: volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01377b-397b-46a8-98e0-4733e44a10bf]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-377c6948-9fae-4761-8515-a17e18eccec8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-152525e1-9cc4-4da7-b400-a81d12de95a1-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:28 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 Sep 11 23:19:28 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (54c32711-43fe-4996-8a87-cd7422d07f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134776e6-92a2-41fa-a2e8-2e216d670c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:28 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134776e6-92a2-41fa-a2e8-2e216d670c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861488822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3005fbe2-a18f-4f2e-9686-df63f5d58ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:28Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e3638-df3c-44d8-8ce6-f41a19154b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e3638-df3c-44d8-8ce6-f41a19154b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd5dcc8-e57e-4ffa-b873-c2d4dbc01901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd5dcc8-e57e-4ffa-b873-c2d4dbc01901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3005fbe2-a18f-4f2e-9686-df63f5d58ea6', 'volume_name': 'volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f1c1b8-5d45-4fb2-8bb4-547ee2105bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f1c1b8-5d45-4fb2-8bb4-547ee2105bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdfde45-ab68-4312-9019-5eece14ab7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:28 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Volume 3005fbe2-a18f-4f2e-9686-df63f5d58ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6', 'volume_size': 1} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861488822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3005fbe2-a18f-4f2e-9686-df63f5d58ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:28Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Creating volume 3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:28 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12" returned: 0 in 0.455s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:28 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 1073741824 Sep 11 23:19:28 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b7372d-063a-4b1f-b213-cb331602c23f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 Sep 11 23:19:28 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 1073741824" returned: 0 in 0.455s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:29 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 Sep 11 23:19:29 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1" returned: 0 in 0.557s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:29 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 Sep 11 23:19:29 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" returned: 0 in 0.245s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdfde45-ab68-4312-9019-5eece14ab7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10832cd0-bfb0-4006-a6f0-b96126dde420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:29 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Volume volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 (3005fbe2-a18f-4f2e-9686-df63f5d58ea6): created successfully Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10832cd0-bfb0-4006-a6f0-b96126dde420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (54c32711-43fe-4996-8a87-cd7422d07f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:29 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ac992b65-4049-4aa9-b8df-25615c5f50ec tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:29 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12" returned: 0 in 0.382s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:29 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12 Sep 11 23:19:29 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot 791c8de9-88fd-423a-b937-d6ad7a0036f9 of volume 3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f0f28f-88b7-4e68-8c10-175833c0e58a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:29 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 Sep 11 23:19:29 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1.097d7045-920f-4ccb-bceb-419adaf2fc12" returned: 0 in 0.305s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-097d7045-920f-4ccb-bceb-419adaf2fc12" released by "_delete_snapshot" :: held 1.826s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-0643afb9-5ec3-4409-81a1-0710cb5e65e1" released by "delete_snapshot" :: held 1.851s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Created reservations ['953bd730-b68d-4186-8507-ecc59476e52a', '31be9274-2997-4b11-828f-1d57ae376693', '030ee4f9-6c64-48ce-9674-ca136c423f34', '1d351980-dd54-4cad-a5d7-faf9792aaf76'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Delete snapshot completed successfully. Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d5c0bc5d-d98f-4c6b-89b1-251132c7286a tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-097d7045-920f-4ccb-bceb-419adaf2fc12-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:30 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" returned: 0 in 0.372s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 1G Sep 11 23:19:30 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-0643afb9-5ec3-4409-81a1-0710cb5e65e1-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-0643afb9-5ec3-4409-81a1-0710cb5e65e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-quobyte-0643afb9-5ec3-4409-81a1-0710cb5e65e1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-0643afb9-5ec3-4409-81a1-0710cb5e65e1" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c973a-f3d2-4e18-bd1f-37ab1f33dc1a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 Sep 11 23:19:30 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 1G" returned: 0 in 0.422s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 Sep 11 23:19:30 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1" returned: 0 in 0.370s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1 Sep 11 23:19:30 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 is being set with open permissions: ugo+rw Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 Sep 11 23:19:30 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0643afb9-5ec3-4409-81a1-0710cb5e65e1" returned: 0 in 0.252s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-0643afb9-5ec3-4409-81a1-0710cb5e65e1" released by "delete_volume" :: held 0.685s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:30 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Created reservations ['7ef729f4-9978-46c6-8b36-c4946432ce1d', '78f323eb-3070-46c6-9d58-4841a3586784', 'c729ed95-494a-4773-a189-fae12b10cb68', '2a96d6e4-89e0-4ad1-8072-37b9f3b5e1de'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:31 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9" returned: 0 in 0.279s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info Sep 11 23:19:31 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.267s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Deleted volume successfully. Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-7366735c-7d2d-40da-8940-6522e0037e32 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-0643afb9-5ec3-4409-81a1-0710cb5e65e1-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-bf0ff113-84d0-4158-a970-4fa3a3c631a8-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-bf0ff113-84d0-4158-a970-4fa3a3c631a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:31 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info" returned: 0 in 0.274s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info is being set with open permissions: ugo+rw Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info Sep 11 23:19:31 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "cinder-quobyte-bf0ff113-84d0-4158-a970-4fa3a3c631a8" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-bf0ff113-84d0-4158-a970-4fa3a3c631a8" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99b6b7-3753-4ae3-8045-8d8274d6e746]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 Sep 11 23:19:31 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.info" returned: 0 in 0.282s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:31 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8cef6796-6bf4-4137-b234-e3a174bb5fe9 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:19:31 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8" returned: 0 in 0.353s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8 Sep 11 23:19:31 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:32 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-bf0ff113-84d0-4158-a970-4fa3a3c631a8" returned: 0 in 0.263s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-quobyte-bf0ff113-84d0-4158-a970-4fa3a3c631a8" released by "delete_volume" :: held 0.655s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Created reservations ['dae96f4b-f22e-435f-9214-fd906bf6314c', '21e58286-b8bd-4956-ad6f-7d888f30d506', '15c50701-ea5b-4f37-900a-cd16ede85012', '9f5fa3c8-425b-41cb-a11f-a6ab7d683fef'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:32 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:32 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:32 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Deleted volume successfully. Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ee7519ac-a8e8-4b7d-b7f9-c1ceccb10884 tempest-SnapshotDependencyTests-1351776231 None] Lock "cinder-bf0ff113-84d0-4158-a970-4fa3a3c631a8-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-791c8de9-88fd-423a-b937-d6ad7a0036f9-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Lock "cinder-791c8de9-88fd-423a-b937-d6ad7a0036f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-791c8de9-88fd-423a-b937-d6ad7a0036f9" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-791c8de9-88fd-423a-b937-d6ad7a0036f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot 791c8de9-88fd-423a-b937-d6ad7a0036f9 of volume 3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd49442-18c3-4823-bbd1-6eb0a240609e]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:33 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 Sep 11 23:19:33 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:33 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9" returned: 0 in 0.395s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:33 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:33 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b79e88-e7c4-419a-b7e0-a3b7c8562b92]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:33 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 Sep 11 23:19:33 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:33 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" returned: 0 in 0.372s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:33 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 Sep 11 23:19:33 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:34 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9" returned: 0 in 0.396s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:34 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9 Sep 11 23:19:34 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:34 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6.791c8de9-88fd-423a-b937-d6ad7a0036f9" returned: 0 in 0.232s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-791c8de9-88fd-423a-b937-d6ad7a0036f9" released by "_delete_snapshot" :: held 1.519s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" released by "delete_snapshot" :: held 1.543s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Created reservations ['1146e88d-29cf-4fd3-9e67-b7ae7f5dd3b8', '0c097596-362f-4ab2-a274-725fe3871d33', 'c13fa8b4-1c4d-4374-8b0e-8749f84394e5', 'd16c1d1e-d7d7-468b-acaf-c2b67fa9a6f4'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:34 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:19:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-81a4ad95-76a2-4bf4-a1fc-ba4664d0afa4 tempest-ProjectMemberTests-842029992 None] Lock "cinder-791c8de9-88fd-423a-b937-d6ad7a0036f9-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-3005fbe2-a18f-4f2e-9686-df63f5d58ea6-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Lock "cinder-3005fbe2-a18f-4f2e-9686-df63f5d58ea6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee95164-736e-470e-9e82-2551a488539f]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:35 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 Sep 11 23:19:35 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:35 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" returned: 0 in 0.338s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:35 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6 Sep 11 23:19:35 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:35 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3005fbe2-a18f-4f2e-9686-df63f5d58ea6" released by "delete_volume" :: held 0.622s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Created reservations ['03457f90-5594-4e29-8e81-ee4153144854', 'e0e6d7e1-b61f-46ca-935b-61fbe4972157', '03f8b593-77e8-4f6b-82ea-093cb1b116bb', 'c15e82f1-3fe3-46ef-909c-4c19077acbe0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:35 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:35 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:36 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:36 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-33c24f8b-7053-427e-8756-2d7d31662cf1 tempest-ProjectMemberTests-842029992 None] Lock "cinder-3005fbe2-a18f-4f2e-9686-df63f5d58ea6-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (c0ebb2c4-df1e-4fc5-8105-22a0d39e234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86181e28-ca8b-44c5-919c-6ce9d727653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86181e28-ca8b-44c5-919c-6ce9d727653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184407904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2ed090-63c4-4d21-8ae9-79732ca40b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:37Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8580bb54-09d5-45ed-bb3b-2f858676c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8580bb54-09d5-45ed-bb3b-2f858676c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3621f9c-1396-454a-9686-ad5d368026ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3621f9c-1396-454a-9686-ad5d368026ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2ed090-63c4-4d21-8ae9-79732ca40b7b', 'volume_name': 'volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31c93aa-674b-41ca-b57a-91ecea2dc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31c93aa-674b-41ca-b57a-91ecea2dc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8167623f-e3e2-4d85-b72c-343a36e7deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Volume 3b2ed090-63c4-4d21-8ae9-79732ca40b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b', 'volume_size': 1} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184407904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2ed090-63c4-4d21-8ae9-79732ca40b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:37Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Creating volume 3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:36 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:36 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b 1073741824 Sep 11 23:19:36 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:37 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b 1073741824" returned: 0 in 0.434s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:37 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b Sep 11 23:19:37 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:37 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" returned: 0 in 0.260s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8167623f-e3e2-4d85-b72c-343a36e7deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16565ec-a095-47f8-b753-57f689b3564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:37 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Volume volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b (3b2ed090-63c4-4d21-8ae9-79732ca40b7b): created successfully Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16565ec-a095-47f8-b753-57f689b3564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (c0ebb2c4-df1e-4fc5-8105-22a0d39e234b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-60f9dbf5-c773-4ca8-abac-a38c59c55887 tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot e50b0bf3-d045-4a9f-977d-6119e783ec7c of volume 3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[291575b0-f27b-4333-8b91-cc585d88e6d2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:38 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b Sep 11 23:19:38 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:38 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" returned: 0 in 0.368s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:38 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c 1G Sep 11 23:19:38 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:38 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c 1G" returned: 0 in 0.378s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:38 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c Sep 11 23:19:38 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:39 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c is being set with open permissions: ugo+rw Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:39 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c Sep 11 23:19:39 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:39 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c" returned: 0 in 0.238s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:39 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info Sep 11 23:19:39 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:39 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info" returned: 0 in 0.247s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info is being set with open permissions: ugo+rw Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:39 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info Sep 11 23:19:39 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:39 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.info" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9e3aa1f2-0eca-4481-860b-b0c05136b974 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-e50b0bf3-d045-4a9f-977d-6119e783ec7c-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Lock "cinder-e50b0bf3-d045-4a9f-977d-6119e783ec7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-e50b0bf3-d045-4a9f-977d-6119e783ec7c" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-e50b0bf3-d045-4a9f-977d-6119e783ec7c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot e50b0bf3-d045-4a9f-977d-6119e783ec7c of volume 3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[46172a04-79ae-4242-b719-4098450120c1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:40 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c Sep 11 23:19:40 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:40 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c" returned: 0 in 0.341s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211d2e9-f06e-4fe6-ba99-3c802e4e7dd1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:40 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b Sep 11 23:19:40 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:40 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:40 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c Sep 11 23:19:40 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:41 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c" returned: 0 in 0.412s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:41 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c Sep 11 23:19:41 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:41 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b.e50b0bf3-d045-4a9f-977d-6119e783ec7c" returned: 0 in 0.257s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-e50b0bf3-d045-4a9f-977d-6119e783ec7c" released by "_delete_snapshot" :: held 1.459s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" released by "delete_snapshot" :: held 1.480s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Created reservations ['df10effa-439c-491d-a0ff-08e8a9d17362', '7b32c70d-a12a-46f9-9422-454b817d9197', 'bff86e4a-e23e-43fb-a548-06a829e31038', 'ffd7a9af-ab2f-43d5-a067-bfcf5005177b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:41 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:19:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-549fde8a-4ac3-4eb8-929f-4a20e7c36b13 tempest-ProjectMemberTests-842029992 None] Lock "cinder-e50b0bf3-d045-4a9f-977d-6119e783ec7c-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-3b2ed090-63c4-4d21-8ae9-79732ca40b7b-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Lock "cinder-3b2ed090-63c4-4d21-8ae9-79732ca40b7b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" acquired by "delete_volume" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb176944-e170-48ea-a2e5-a5064ba0e42a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:42 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b Sep 11 23:19:42 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:42 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" returned: 0 in 0.388s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:42 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b Sep 11 23:19:42 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:43 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" returned: 0 in 0.273s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-3b2ed090-63c4-4d21-8ae9-79732ca40b7b" released by "delete_volume" :: held 0.720s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Created reservations ['3abf7a1d-bff4-4b0f-99bc-0435c90eefc3', '79d63ead-4b19-4baa-8043-2ac6e8f1992b', 'cd2c9988-8ea1-4767-b6da-16ec9de035ca', 'e050acb4-47d0-4756-8f61-fdc8a77cea3c'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:43 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:43 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:43 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.303s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:43 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-6a0e5e0d-0d23-4711-8f5e-fedd32801f52 tempest-ProjectMemberTests-842029992 None] Lock "cinder-3b2ed090-63c4-4d21-8ae9-79732ca40b7b-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (7abbe701-ec82-4d0a-953c-77758ee47c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55adbdd-53b6-4f8d-9bc4-dd4daa11f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55adbdd-53b6-4f8d-9bc4-dd4daa11f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198500519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94fae11-b018-4910-b991-ea04c42c8745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94fae11-b018-4910-b991-ea04c42c8745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edab0dd9-e8f9-4a2a-bfc9-8ca270c23513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edab0dd9-e8f9-4a2a-bfc9-8ca270c23513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c', 'volume_name': 'volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62c5ddc-f371-4476-a1ec-d46980401c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62c5ddc-f371-4476-a1ec-d46980401c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b45ea-b534-4251-8038-5edeb46615c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Volume c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c', 'volume_size': 1} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198500519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Creating volume c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:44 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:44 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c 1073741824 Sep 11 23:19:44 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:44 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c 1073741824" returned: 0 in 0.374s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:44 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c Sep 11 23:19:44 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:44 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" returned: 0 in 0.244s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b45ea-b534-4251-8038-5edeb46615c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8352d544-e5c9-4964-b0f6-b2d754dad401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Volume volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c (c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c): created successfully Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8352d544-e5c9-4964-b0f6-b2d754dad401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (7abbe701-ec82-4d0a-953c-77758ee47c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:44 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1a5ba036-e1e5-4a2b-890c-6cdb9b66a4cb tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot de144720-d953-483d-8719-f7fdbf0fef76 of volume c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746038e-54aa-492e-a563-4e1da5783b57]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:45 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c Sep 11 23:19:45 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:45 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" returned: 0 in 0.340s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:45 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 1G Sep 11 23:19:45 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:45 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 1G" returned: 0 in 0.383s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:45 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:45 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 Sep 11 23:19:45 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:46 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76" returned: 0 in 0.283s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:46 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 is being set with open permissions: ugo+rw Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:46 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 Sep 11 23:19:46 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:46 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76" returned: 0 in 0.239s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:46 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info Sep 11 23:19:46 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:46 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info" returned: 0 in 0.253s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:46 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info is being set with open permissions: ugo+rw Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:46 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info Sep 11 23:19:46 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:46 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.info" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:46 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=159,cinder:INSERT=53,cinder:UPDATE=203,cinder:DELETE=19 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:19:46 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-7dbacb8e-c490-48d9-8181-b7a539010648 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-de144720-d953-483d-8719-f7fdbf0fef76-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Lock "cinder-de144720-d953-483d-8719-f7fdbf0fef76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-de144720-d953-483d-8719-f7fdbf0fef76" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-de144720-d953-483d-8719-f7fdbf0fef76" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot de144720-d953-483d-8719-f7fdbf0fef76 of volume c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[18754d75-02af-44b7-8fe1-c1e2e3719a62]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:47 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 Sep 11 23:19:47 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:47 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76" returned: 0 in 0.337s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6790b-1b92-4608-9582-3dd5b73d8ac4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:47 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c Sep 11 23:19:47 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:47 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" returned: 0 in 0.337s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:48 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 Sep 11 23:19:48 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:48 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:48 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76 Sep 11 23:19:48 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:48 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c.de144720-d953-483d-8719-f7fdbf0fef76" returned: 0 in 0.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-de144720-d953-483d-8719-f7fdbf0fef76" released by "_delete_snapshot" :: held 1.306s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" released by "delete_snapshot" :: held 1.327s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=154,cinder:INSERT=55,cinder:UPDATE=204,cinder:DELETE=15 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Created reservations ['b917bc25-2edf-4222-b0e7-d5e79e0c3419', '9f3dc35a-c4d1-4a3d-891b-3ba79a1d985d', '66c4112a-9aee-47d4-a1e5-bda30b225f28', 'a300af0e-71ee-410c-90c8-5abc9d05f12f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:19:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-d6ca76df-4791-41ad-996f-7da668c49857 tempest-ProjectMemberTests-842029992 None] Lock "cinder-de144720-d953-483d-8719-f7fdbf0fef76-delete_snapshot" released by "delete_snapshot" :: held 1.459s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Lock "cinder-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[821859b4-4743-4e6c-9802-ff1258bdd611]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c Sep 11 23:19:49 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:49 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" returned: 0 in 0.345s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c Sep 11 23:19:49 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c" released by "delete_volume" :: held 0.628s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Created reservations ['b163aa76-875b-40a8-ac32-68cd23630054', '32c2cdf5-bd1d-442c-8bef-fbd9e9cdc0ce', '1f35e3be-660f-4685-b9b8-f10e9366cada', '7a2e3ba8-7768-4700-a3fd-b181d2120653'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:50 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:50 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:50 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-e35d704c-0ac7-496c-a130-d518d7f687de tempest-ProjectMemberTests-842029992 None] Lock "cinder-c51b1ac1-611f-4fc5-8a8d-10fa2fd09d1c-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (dcd65fd9-1424-4f9d-8e17-7224d9de6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f6ea68-5787-45cd-bc9d-6fc379ebcfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f6ea68-5787-45cd-bc9d-6fc379ebcfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280346829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b386fe7-a144-4409-a7c3-e4c7d6b28a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:51Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f73adf-6cd6-403a-b352-0f1825f909d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:50 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f73adf-6cd6-403a-b352-0f1825f909d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace65e12-a726-42cf-af8a-e2f238e7ac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace65e12-a726-42cf-af8a-e2f238e7ac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b386fe7-a144-4409-a7c3-e4c7d6b28a6f', 'volume_name': 'volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1305cd8f-83e0-4f6a-b0ed-be16433264d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1305cd8f-83e0-4f6a-b0ed-be16433264d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428854e6-4fc1-4078-96f8-148303179c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Volume 1b386fe7-a144-4409-a7c3-e4c7d6b28a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f', 'volume_size': 1} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280346829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b386fe7-a144-4409-a7c3-e4c7d6b28a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:51Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Creating volume 1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:51 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f 1073741824 Sep 11 23:19:51 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f 1073741824" returned: 0 in 0.389s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f Sep 11 23:19:51 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" returned: 0 in 0.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428854e6-4fc1-4078-96f8-148303179c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afced7d0-9166-4659-95e6-3c26115b3218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:51 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Volume volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f (1b386fe7-a144-4409-a7c3-e4c7d6b28a6f): created successfully Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afced7d0-9166-4659-95e6-3c26115b3218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (dcd65fd9-1424-4f9d-8e17-7224d9de6214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c01bdd22-af22-4a36-9fb3-f104b2b4fc9a tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot 5696b121-44f1-4194-90ba-2205dd6abcdf of volume 1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[68487da2-fbbd-4528-8c36-fde6fa3e2ba3]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f Sep 11 23:19:52 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" returned: 0 in 0.340s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf 1G Sep 11 23:19:52 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf 1G" returned: 0 in 0.377s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf Sep 11 23:19:52 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf" returned: 0 in 0.281s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf is being set with open permissions: ugo+rw Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf Sep 11 23:19:53 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf" returned: 0 in 0.233s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info Sep 11 23:19:53 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info is being set with open permissions: ugo+rw Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info Sep 11 23:19:53 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.info" returned: 0 in 0.246s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:53 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-79b800d8-8249-4f1f-9902-99f0e3811d57 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-5696b121-44f1-4194-90ba-2205dd6abcdf-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-5696b121-44f1-4194-90ba-2205dd6abcdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-5696b121-44f1-4194-90ba-2205dd6abcdf" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-5696b121-44f1-4194-90ba-2205dd6abcdf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot 5696b121-44f1-4194-90ba-2205dd6abcdf of volume 1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e40bc8f-578a-43cf-8203-55cdf326bcd5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf Sep 11 23:19:54 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf" returned: 0 in 0.346s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc32efd-d186-4495-9212-35935e320d23]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f Sep 11 23:19:54 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf Sep 11 23:19:54 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf" returned: 0 in 0.314s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:55 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf Sep 11 23:19:55 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f.5696b121-44f1-4194-90ba-2205dd6abcdf" returned: 0 in 0.235s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-5696b121-44f1-4194-90ba-2205dd6abcdf" released by "_delete_snapshot" :: held 1.312s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" released by "delete_snapshot" :: held 1.330s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Created reservations ['69de2f2b-9a78-4b48-8c5e-94c4748c436a', '2757ad66-45a0-4f8a-bde4-a9051f5899b0', '1dfee871-febe-4924-9121-62fc46d52de5', '4192ab15-96f3-4b0f-a262-061d3a3e6d81'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:55 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:19:55 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-c9521f27-ad1a-40a9-bb0b-a770d93c92a8 tempest-ProjectMemberTests-842029992 None] Lock "cinder-5696b121-44f1-4194-90ba-2205dd6abcdf-delete_snapshot" released by "delete_snapshot" :: held 1.453s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Lock "cinder-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a0448-c14c-4218-8c22-9b61691d54e4]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f Sep 11 23:19:56 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" returned: 0 in 0.352s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f Sep 11 23:19:56 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f" released by "delete_volume" :: held 0.645s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Created reservations ['963c0a0e-26db-498b-920c-d708a8321110', '827b21a5-17c6-4ea6-af94-dba1c1f9448e', '6e968ce7-aab3-4f30-a29c-7ee05f7d99e8', 'dde4c435-724e-47db-93b6-b010e06c0fb0'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:57 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.250s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:57 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8c710b66-3cb0-4ef9-845f-3bdda48be94f tempest-ProjectMemberTests-842029992 None] Lock "cinder-1b386fe7-a144-4409-a7c3-e4c7d6b28a6f-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (9d9a1cb1-163b-4ab8-a436-918e3315298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba0a68-8b81-4272-a5a4-412f36db5505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba0a68-8b81-4272-a5a4-412f36db5505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161325935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce16592-b007-4323-bdbc-4f9d96e230e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:58Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02ee01e-042f-4289-a611-0b8ceaef4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02ee01e-042f-4289-a611-0b8ceaef4bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df2c8d8-c281-4fd7-8b9d-360dd1438eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df2c8d8-c281-4fd7-8b9d-360dd1438eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce16592-b007-4323-bdbc-4f9d96e230e7', 'volume_name': 'volume-7ce16592-b007-4323-bdbc-4f9d96e230e7', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662ee1c6-36e4-42c6-af45-31f907b7d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662ee1c6-36e4-42c6-af45-31f907b7d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6565a5d7-381d-4d5e-bf96-870e964a55a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:57 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Volume 7ce16592-b007-4323-bdbc-4f9d96e230e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce16592-b007-4323-bdbc-4f9d96e230e7', 'volume_size': 1} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161325935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce16592-b007-4323-bdbc-4f9d96e230e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229ca0bd78aa4864a256161b18f6ff35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:58Z,use_quota=True,user_id='0fa3e330e2cd4d6db3e43d97bc4cbd3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Creating volume 7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:57 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:19:57 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:58 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 1073741824 Sep 11 23:19:58 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:58 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 1073741824" returned: 0 in 0.401s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:58 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 Sep 11 23:19:58 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:58 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6565a5d7-381d-4d5e-bf96-870e964a55a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce16592-b007-4323-bdbc-4f9d96e230e7', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361b1945-88ab-4ebd-8653-9216086e3472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:58 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Volume volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 (7ce16592-b007-4323-bdbc-4f9d96e230e7): created successfully Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361b1945-88ab-4ebd-8653-9216086e3472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:58 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Flow 'volume_create_manager' (9d9a1cb1-163b-4ab8-a436-918e3315298b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:58 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bfab84a9-ce99-4b26-b9c7-d314f7aaf3fe tempest-ProjectMemberTests-842029992 None] Created volume successfully. Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Creating offline snapshot 7da35597-bfcc-48d1-a71d-4af0642c7bb6 of volume 7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5ad07-711b-4502-a012-4e12631919d2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:19:59 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 Sep 11 23:19:59 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.239s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:19:59 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7" returned: 0 in 0.360s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 1G Sep 11 23:19:59 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 1G" returned: 0 in 0.380s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 Sep 11 23:19:59 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6" returned: 0 in 0.286s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 is being set with open permissions: ugo+rw Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 Sep 11 23:20:00 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6" returned: 0 in 0.229s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info Sep 11 23:20:00 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info" returned: 0 in 0.244s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info is being set with open permissions: ugo+rw Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info Sep 11 23:20:00 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.info" returned: 0 in 0.251s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:00 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8d10c625-8893-4e69-9529-0583d4ecc822 tempest-ProjectMemberTests-842029992 None] Create snapshot completed successfully Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-7da35597-bfcc-48d1-a71d-4af0642c7bb6-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Lock "cinder-7da35597-bfcc-48d1-a71d-4af0642c7bb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-7ce16592-b007-4323-bdbc-4f9d96e230e7" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-7ce16592-b007-4323-bdbc-4f9d96e230e7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-7da35597-bfcc-48d1-a71d-4af0642c7bb6" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-7da35597-bfcc-48d1-a71d-4af0642c7bb6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Deleting offline snapshot 7da35597-bfcc-48d1-a71d-4af0642c7bb6 of volume 7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] snapshot_file for this snap is: volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[696192bb-8f49-476c-9156-885a39ca65f1]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:01 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 Sep 11 23:20:01 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:01 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6" returned: 0 in 0.352s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce16592-b007-4323-bdbc-4f9d96e230e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bf7a1-5984-495b-9556-ebc51c2c5404]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:01 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:01 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 Sep 11 23:20:01 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:02 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:02 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 Sep 11 23:20:02 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:02 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6" returned: 0 in 0.325s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:02 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6 Sep 11 23:20:02 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:02 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7.7da35597-bfcc-48d1-a71d-4af0642c7bb6" returned: 0 in 0.230s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-7da35597-bfcc-48d1-a71d-4af0642c7bb6" released by "_delete_snapshot" :: held 1.341s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-7ce16592-b007-4323-bdbc-4f9d96e230e7" released by "delete_snapshot" :: held 1.364s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Created reservations ['91193a88-4677-4cd0-942d-62c18a8a930b', '6065b1ac-71a2-4749-8878-fb03f23c3cbf', '8bd99160-08cd-4755-9022-6b087a007408', 'b733e841-946b-4506-9317-c97f0f3a2312'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:02 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Delete snapshot completed successfully. Sep 11 23:20:02 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-0423de7f-1fe3-4600-b022-eaf5d5edb92b tempest-ProjectMemberTests-842029992 None] Lock "cinder-7da35597-bfcc-48d1-a71d-4af0642c7bb6-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-7ce16592-b007-4323-bdbc-4f9d96e230e7-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Lock "cinder-7ce16592-b007-4323-bdbc-4f9d96e230e7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Acquiring lock "cinder-quobyte-7ce16592-b007-4323-bdbc-4f9d96e230e7" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-7ce16592-b007-4323-bdbc-4f9d96e230e7" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f191b1-dfbd-4c19-b78e-9557afa5a3e2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 Sep 11 23:20:03 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:03 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7" returned: 0 in 0.353s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:03 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7 Sep 11 23:20:03 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7ce16592-b007-4323-bdbc-4f9d96e230e7" returned: 0 in 0.228s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Lock "cinder-quobyte-7ce16592-b007-4323-bdbc-4f9d96e230e7" released by "delete_volume" :: held 0.641s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Created reservations ['41239c2e-e98f-41b6-bb86-f19947873841', 'ea9eba41-93c4-441a-82b6-efc916ad916e', '928a6384-2129-4a8c-8e00-9bc21757e3cf', 'fbc53739-a0e5-4130-b302-ac61e9ec6bad'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:04 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:04 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.229s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:04 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Deleted volume successfully. Sep 11 23:20:04 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-1b3bec0a-07f1-422c-a17e-183fa16f3ca5 tempest-ProjectMemberTests-842029992 None] Lock "cinder-7ce16592-b007-4323-bdbc-4f9d96e230e7-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:07 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (8ff20583-7ab8-4b59-8dba-59ef4ab92c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a928fb23-1a32-488b-ad23-af2180fedff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a928fb23-1a32-488b-ad23-af2180fedff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422305066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a4e52c-6cdc-4109-9914-157c0c06ade1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:08Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3007e7f0-2836-419a-8599-c226d34fd9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3007e7f0-2836-419a-8599-c226d34fd9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da37173e-ee9e-4024-a74f-1f2fa3a35be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da37173e-ee9e-4024-a74f-1f2fa3a35be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a4e52c-6cdc-4109-9914-157c0c06ade1', 'volume_name': 'volume-93a4e52c-6cdc-4109-9914-157c0c06ade1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dff2b55-b90a-4925-96ef-cabf85419e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dff2b55-b90a-4925-96ef-cabf85419e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc4b191-3dd6-47e5-b5b9-30979904efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Volume 93a4e52c-6cdc-4109-9914-157c0c06ade1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a4e52c-6cdc-4109-9914-157c0c06ade1', 'volume_size': 1} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422305066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a4e52c-6cdc-4109-9914-157c0c06ade1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:08Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Creating volume 93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:08 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:08 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 1073741824 Sep 11 23:20:08 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:08 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 1073741824" returned: 0 in 0.387s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:08 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 Sep 11 23:20:08 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:08 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc4b191-3dd6-47e5-b5b9-30979904efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a4e52c-6cdc-4109-9914-157c0c06ade1', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a623afcc-f4a0-4b0e-b83a-3150341aaf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Volume volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 (93a4e52c-6cdc-4109-9914-157c0c06ade1): created successfully Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a623afcc-f4a0-4b0e-b83a-3150341aaf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (8ff20583-7ab8-4b59-8dba-59ef4ab92c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:08 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-bb861363-8c9b-4ec2-834a-6f253d9ba24a tempest-ProjectReaderTests-1508849324 None] Created volume successfully. Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Creating offline snapshot 9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 of volume 93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c7759-4b94-4113-8428-6db04e851cbb]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:09 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 Sep 11 23:20:09 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:09 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1" returned: 0 in 0.343s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:09 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 1G Sep 11 23:20:09 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:09 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 1G" returned: 0 in 0.373s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:09 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:09 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 Sep 11 23:20:09 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" returned: 0 in 0.277s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:10 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 is being set with open permissions: ugo+rw Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:10 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 Sep 11 23:20:10 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:10 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info Sep 11 23:20:10 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:10 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info is being set with open permissions: ugo+rw Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:10 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info Sep 11 23:20:10 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.info" returned: 0 in 0.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:10 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:10 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-cedf03ad-9906-4987-aa22-0c0485af89bd tempest-ProjectReaderTests-1508849324 None] Create snapshot completed successfully Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-9e41ffcb-2639-4fd6-a6b8-62f0d20252d1-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-9e41ffcb-2639-4fd6-a6b8-62f0d20252d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-93a4e52c-6cdc-4109-9914-157c0c06ade1" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-93a4e52c-6cdc-4109-9914-157c0c06ade1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Deleting offline snapshot 9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 of volume 93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] snapshot_file for this snap is: volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e7e3e7-64ea-4bdc-9b45-bb24470a0498]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 Sep 11 23:20:11 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:11 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93a4e52c-6cdc-4109-9914-157c0c06ade1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd0cee0-0b34-4341-b507-43513004951a]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:11 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 Sep 11 23:20:11 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:12 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1" returned: 0 in 0.343s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:12 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 Sep 11 23:20:12 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:12 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" returned: 0 in 0.321s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:12 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1 Sep 11 23:20:12 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:12 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1.9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-9e41ffcb-2639-4fd6-a6b8-62f0d20252d1" released by "_delete_snapshot" :: held 1.331s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-93a4e52c-6cdc-4109-9914-157c0c06ade1" released by "delete_snapshot" :: held 1.353s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Created reservations ['a493eeb6-9d09-4979-bd05-6a1306bcfa89', 'bee0c506-58a6-4ccb-8590-61c80e32b1e5', 'b21974b7-d5ef-42e0-997a-ec60673b49fa', 'd01e9e87-61a8-454b-8ee7-5454d63c6877'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:12 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Delete snapshot completed successfully. Sep 11 23:20:12 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-69836b33-41fa-42a3-97c7-2ca2b67a1b23 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-9e41ffcb-2639-4fd6-a6b8-62f0d20252d1-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-93a4e52c-6cdc-4109-9914-157c0c06ade1-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Lock "cinder-93a4e52c-6cdc-4109-9914-157c0c06ade1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-93a4e52c-6cdc-4109-9914-157c0c06ade1" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-93a4e52c-6cdc-4109-9914-157c0c06ade1" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eb057c-6f2d-46d8-a22a-0db5b08acefd]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:13 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 Sep 11 23:20:13 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:13 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1" returned: 0 in 0.348s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:13 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:14 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1 Sep 11 23:20:14 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:14 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-93a4e52c-6cdc-4109-9914-157c0c06ade1" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-93a4e52c-6cdc-4109-9914-157c0c06ade1" released by "delete_volume" :: held 0.643s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Created reservations ['ac4fc926-7dcf-4fad-832b-4366493a456b', 'e01095ea-9912-423a-ba5d-a9af846d92d5', '6df40924-9445-4b0f-a839-6976724f2666', '3dbb20b0-55b7-4369-9589-d43254ff6ace'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:14 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:14 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:14 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.244s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:14 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Deleted volume successfully. Sep 11 23:20:14 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-194a19c6-9d7c-4965-8712-9269e703bc2c tempest-ProjectReaderTests-1508849324 None] Lock "cinder-93a4e52c-6cdc-4109-9914-157c0c06ade1-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (7154e627-1a07-4e69-9af7-c8758ffdaaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7511b99b-6bad-4303-8b55-2e04decd93ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7511b99b-6bad-4303-8b55-2e04decd93ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331143914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63b42b-23af-42d9-be27-583ee0edfb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:15Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90257441-ff42-4bfb-9197-8e6dceafd7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90257441-ff42-4bfb-9197-8e6dceafd7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af538e1f-a1f7-4fee-9da5-3601713ccd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af538e1f-a1f7-4fee-9da5-3601713ccd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d63b42b-23af-42d9-be27-583ee0edfb62', 'volume_name': 'volume-7d63b42b-23af-42d9-be27-583ee0edfb62', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807a2740-873f-4ffc-b387-22b2a4e46447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807a2740-873f-4ffc-b387-22b2a4e46447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfc9cf8-7e50-4ee0-b541-359bdfbf6fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Volume 7d63b42b-23af-42d9-be27-583ee0edfb62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d63b42b-23af-42d9-be27-583ee0edfb62', 'volume_size': 1} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331143914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63b42b-23af-42d9-be27-583ee0edfb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:15Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Creating volume 7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:15 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:15 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 1073741824 Sep 11 23:20:15 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:15 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 1073741824" returned: 0 in 0.401s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:15 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 Sep 11 23:20:15 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:15 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62" returned: 0 in 0.231s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfc9cf8-7e50-4ee0-b541-359bdfbf6fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d63b42b-23af-42d9-be27-583ee0edfb62', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3612a2a-630e-4070-b70f-108d046618f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:15 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Volume volume-7d63b42b-23af-42d9-be27-583ee0edfb62 (7d63b42b-23af-42d9-be27-583ee0edfb62): created successfully Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3612a2a-630e-4070-b70f-108d046618f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:15 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (7154e627-1a07-4e69-9af7-c8758ffdaaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:15 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-3626b598-14cb-4f7c-a8e9-218870103f76 tempest-ProjectReaderTests-1508849324 None] Created volume successfully. Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Creating offline snapshot 5026e394-39b9-4779-aea0-ed0063b84b55 of volume 7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[a246d4b7-d755-497d-9cc8-b2b362c54057]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:16 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 Sep 11 23:20:16 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:16 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62" returned: 0 in 0.357s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:16 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:16 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 1G Sep 11 23:20:16 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 1G" returned: 0 in 0.352s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d63b42b-23af-42d9-be27-583ee0edfb62 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d63b42b-23af-42d9-be27-583ee0edfb62 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 Sep 11 23:20:17 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d63b42b-23af-42d9-be27-583ee0edfb62 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55" returned: 0 in 0.293s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 is being set with open permissions: ugo+rw Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 Sep 11 23:20:17 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55" returned: 0 in 0.235s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info Sep 11 23:20:17 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info is being set with open permissions: ugo+rw Sep 11 23:20:17 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info Sep 11 23:20:17 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:18 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.info" returned: 0 in 0.244s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:18 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-5ea4dc4b-5ce2-40a3-adba-bc367c48304f tempest-ProjectReaderTests-1508849324 None] Create snapshot completed successfully Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-5026e394-39b9-4779-aea0-ed0063b84b55-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-5026e394-39b9-4779-aea0-ed0063b84b55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-7d63b42b-23af-42d9-be27-583ee0edfb62" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-7d63b42b-23af-42d9-be27-583ee0edfb62" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-5026e394-39b9-4779-aea0-ed0063b84b55" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-5026e394-39b9-4779-aea0-ed0063b84b55" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Deleting offline snapshot 5026e394-39b9-4779-aea0-ed0063b84b55 of volume 7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] snapshot_file for this snap is: volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[47606257-07d5-4b19-baa6-758cf2c15d42]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:18 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 Sep 11 23:20:18 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:18 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55" returned: 0 in 0.355s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d63b42b-23af-42d9-be27-583ee0edfb62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d85b28f-11a5-4096-8c9d-1026e5f52df7]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:18 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 Sep 11 23:20:19 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:19 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 Sep 11 23:20:19 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:19 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55 Sep 11 23:20:19 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:19 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62.5026e394-39b9-4779-aea0-ed0063b84b55" returned: 0 in 0.242s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-5026e394-39b9-4779-aea0-ed0063b84b55" released by "_delete_snapshot" :: held 1.388s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-7d63b42b-23af-42d9-be27-583ee0edfb62" released by "delete_snapshot" :: held 1.408s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:19 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Created reservations ['aebb4d3e-5e97-499f-98b9-4df7a9ac6002', '6805270f-2253-4a89-8f60-acd9fbfcad06', '57db6a45-f1d1-4ea1-9f85-e1bdddd3a7b4', 'c94f88db-0966-44bc-8334-756b56d4235b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:19 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Delete snapshot completed successfully. Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-9c63ebac-43d1-4b6b-aa8b-81758a91a2a8 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-5026e394-39b9-4779-aea0-ed0063b84b55-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-7d63b42b-23af-42d9-be27-583ee0edfb62-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-7d63b42b-23af-42d9-be27-583ee0edfb62-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-7d63b42b-23af-42d9-be27-583ee0edfb62" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-7d63b42b-23af-42d9-be27-583ee0edfb62" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea6827e-83e1-41cb-8d86-665c084cb91b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:20 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:20 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 Sep 11 23:20:20 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:21 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62" returned: 0 in 0.355s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:21 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62 Sep 11 23:20:21 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:21 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-7d63b42b-23af-42d9-be27-583ee0edfb62" returned: 0 in 0.262s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-7d63b42b-23af-42d9-be27-583ee0edfb62" released by "delete_volume" :: held 0.672s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Created reservations ['a0684d06-f1b3-4947-8e0d-1f4f8bb344d0', '376b63c9-a634-4b40-b120-1d7169acf00c', 'f1c34577-c145-48f3-b60c-d8f29ea9ac7d', '43e179cd-36a0-4363-a701-ddaaef4111a8'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:21 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:21 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:21 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.240s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:21 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Deleted volume successfully. Sep 11 23:20:21 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-94a5d144-d170-4474-9784-4cdf2c19c100 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-7d63b42b-23af-42d9-be27-583ee0edfb62-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (ddb87f2c-efea-4af5-8dab-9432c9e81d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cd1741-16ce-4d68-b501-09ea8a2d5e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cd1741-16ce-4d68-b501-09ea8a2d5e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287074379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769ef58d-f287-4e76-a244-192ded66993e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:22Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a2443b-08b6-473b-b564-b7111a07f932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a2443b-08b6-473b-b564-b7111a07f932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b0ac6a-97f3-4db2-8276-795d63aecd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b0ac6a-97f3-4db2-8276-795d63aecd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769ef58d-f287-4e76-a244-192ded66993e', 'volume_name': 'volume-769ef58d-f287-4e76-a244-192ded66993e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a837687-4c67-4f6b-9377-487760846315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a837687-4c67-4f6b-9377-487760846315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cf200c-43a0-40c6-b6da-11b0982c4b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:22 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Volume 769ef58d-f287-4e76-a244-192ded66993e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769ef58d-f287-4e76-a244-192ded66993e', 'volume_size': 1} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287074379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769ef58d-f287-4e76-a244-192ded66993e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:22Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Creating volume 769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:22 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:22 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e 1073741824 Sep 11 23:20:22 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:22 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e 1073741824" returned: 0 in 0.414s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:22 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e Sep 11 23:20:22 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:22 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cf200c-43a0-40c6-b6da-11b0982c4b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769ef58d-f287-4e76-a244-192ded66993e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:22 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705bb702-aeb8-465a-b2c6-c54bc92033c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:23 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Volume volume-769ef58d-f287-4e76-a244-192ded66993e (769ef58d-f287-4e76-a244-192ded66993e): created successfully Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705bb702-aeb8-465a-b2c6-c54bc92033c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (ddb87f2c-efea-4af5-8dab-9432c9e81d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:23 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0b460237-bf0a-48c6-bd28-95ef648b832c tempest-ProjectReaderTests-1508849324 None] Created volume successfully. Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Creating offline snapshot d737dc22-35aa-4ed5-8407-fb86abbab499 of volume 769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd026c3c-aaef-47b2-b2bc-d7432c0a4cc2]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:23 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e Sep 11 23:20:23 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:23 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e" returned: 0 in 0.339s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:23 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:23 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 1G Sep 11 23:20:23 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:24 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 1G" returned: 0 in 0.371s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-769ef58d-f287-4e76-a244-192ded66993e -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-769ef58d-f287-4e76-a244-192ded66993e -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 Sep 11 23:20:24 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:24 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-769ef58d-f287-4e76-a244-192ded66993e -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499" returned: 0 in 0.284s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 is being set with open permissions: ugo+rw Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 Sep 11 23:20:24 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:24 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499" returned: 0 in 0.242s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info Sep 11 23:20:24 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:24 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info" returned: 0 in 0.251s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info is being set with open permissions: ugo+rw Sep 11 23:20:24 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info Sep 11 23:20:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:25 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.info" returned: 0 in 0.226s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:25 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ec8658e6-6d46-4022-8aa6-b3d4b244927e tempest-ProjectReaderTests-1508849324 None] Create snapshot completed successfully Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-d737dc22-35aa-4ed5-8407-fb86abbab499-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-d737dc22-35aa-4ed5-8407-fb86abbab499-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-769ef58d-f287-4e76-a244-192ded66993e" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-769ef58d-f287-4e76-a244-192ded66993e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-d737dc22-35aa-4ed5-8407-fb86abbab499" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-d737dc22-35aa-4ed5-8407-fb86abbab499" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Deleting offline snapshot d737dc22-35aa-4ed5-8407-fb86abbab499 of volume 769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] snapshot_file for this snap is: volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a212818-5f87-4620-ae1a-52df9de48d26]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:25 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 Sep 11 23:20:25 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:25 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499" returned: 0 in 0.350s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-769ef58d-f287-4e76-a244-192ded66993e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[155fb8d9-0e0c-44ee-9b26-3b63f1b451ca]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:25 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:26 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e Sep 11 23:20:26 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:26 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e" returned: 0 in 0.340s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:26 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 Sep 11 23:20:26 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:26 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499" returned: 0 in 0.332s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:26 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499 Sep 11 23:20:26 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:26 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e.d737dc22-35aa-4ed5-8407-fb86abbab499" returned: 0 in 0.232s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-d737dc22-35aa-4ed5-8407-fb86abbab499" released by "_delete_snapshot" :: held 1.335s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-769ef58d-f287-4e76-a244-192ded66993e" released by "delete_snapshot" :: held 1.357s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:26 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Created reservations ['b61173d1-6371-49f3-95fb-1138f60054a5', '170bd2d4-cf86-4f12-b4cc-ebf5b629f674', '129bc775-3aa5-4b2e-8f2c-3492b81356a1', 'a2993051-c154-46f2-b4c9-1b6b9acf2d20'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:27 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Delete snapshot completed successfully. Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-38dcee49-2c5f-4f70-9dde-ee196415b933 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-d737dc22-35aa-4ed5-8407-fb86abbab499-delete_snapshot" released by "delete_snapshot" :: held 1.491s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-769ef58d-f287-4e76-a244-192ded66993e-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-769ef58d-f287-4e76-a244-192ded66993e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-769ef58d-f287-4e76-a244-192ded66993e" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-769ef58d-f287-4e76-a244-192ded66993e" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f47292-0751-4232-b44e-b9a714746ddb]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:27 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e Sep 11 23:20:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:28 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e" returned: 0 in 0.339s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:28 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e Sep 11 23:20:28 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:28 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-769ef58d-f287-4e76-a244-192ded66993e" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-769ef58d-f287-4e76-a244-192ded66993e" released by "delete_volume" :: held 0.628s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Created reservations ['715b9e48-a16b-4162-8152-7ae4b9013578', 'f135af00-b172-4389-a93f-8cad4758445e', 'd831a621-e0e1-44f5-8051-93e21dd46f99', '5bb21c3d-3d21-41c4-b10a-85608587384f'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:28 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:28 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:28 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.230s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:28 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Deleted volume successfully. Sep 11 23:20:28 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f6baa67b-1d43-4e39-b10f-068d4bd90811 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-769ef58d-f287-4e76-a244-192ded66993e-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (d42f2d48-9780-4297-88e9-b66e7ae1be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7e4912-d3a8-4db8-885d-273f78b859c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7e4912-d3a8-4db8-885d-273f78b859c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207123576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfe46b7-3a58-4522-939a-5fd57ad514c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:29Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ef21b5-a2d3-465c-946f-9173d3497ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ef21b5-a2d3-465c-946f-9173d3497ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ae4a69-69d6-4f59-8e40-479d6581fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ae4a69-69d6-4f59-8e40-479d6581fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfe46b7-3a58-4522-939a-5fd57ad514c4', 'volume_name': 'volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262428b0-0516-4cd8-857b-0f18207162f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262428b0-0516-4cd8-857b-0f18207162f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e7ddd0-c324-445b-a304-5fbe67164fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Volume ecfe46b7-3a58-4522-939a-5fd57ad514c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4', 'volume_size': 1} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207123576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfe46b7-3a58-4522-939a-5fd57ad514c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:29Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Creating volume ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:29 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:29 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 1073741824 Sep 11 23:20:29 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:29 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 1073741824" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:29 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 Sep 11 23:20:29 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:29 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4" returned: 0 in 0.232s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e7ddd0-c324-445b-a304-5fbe67164fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccb4714-c3b2-4e2c-95a7-c3d6464b268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:30 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Volume volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 (ecfe46b7-3a58-4522-939a-5fd57ad514c4): created successfully Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccb4714-c3b2-4e2c-95a7-c3d6464b268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (d42f2d48-9780-4297-88e9-b66e7ae1be7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:30 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-e314d17a-e01d-443f-8dda-eccafcbfa81d tempest-ProjectReaderTests-1508849324 None] Created volume successfully. Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Creating offline snapshot 86839a4c-6620-420f-bb16-6bfaf08cac18 of volume ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ace9b3-e42e-4d51-bfb2-c4f9003b0755]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:30 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 Sep 11 23:20:30 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:30 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4" returned: 0 in 0.334s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:30 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:30 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 1G Sep 11 23:20:30 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:31 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 1G" returned: 0 in 0.367s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:31 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 Sep 11 23:20:31 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:31 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18" returned: 0 in 0.283s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:31 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 is being set with open permissions: ugo+rw Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:31 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 Sep 11 23:20:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:31 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18" returned: 0 in 0.226s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:31 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info Sep 11 23:20:31 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:31 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info" returned: 0 in 0.235s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:31 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info is being set with open permissions: ugo+rw Sep 11 23:20:31 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:31 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info Sep 11 23:20:31 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.info" returned: 0 in 0.224s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.743s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:32 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-2cf17f99-9ed4-4913-ae0d-1705e4dea053 tempest-ProjectReaderTests-1508849324 None] Create snapshot completed successfully Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-86839a4c-6620-420f-bb16-6bfaf08cac18-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-86839a4c-6620-420f-bb16-6bfaf08cac18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-ecfe46b7-3a58-4522-939a-5fd57ad514c4" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-ecfe46b7-3a58-4522-939a-5fd57ad514c4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-86839a4c-6620-420f-bb16-6bfaf08cac18" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-86839a4c-6620-420f-bb16-6bfaf08cac18" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Deleting offline snapshot 86839a4c-6620-420f-bb16-6bfaf08cac18 of volume ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] snapshot_file for this snap is: volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351be21-3144-4bbc-b4c5-17b706f14a26]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:32 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 Sep 11 23:20:32 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18" returned: 0 in 0.347s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f537bb7b-2381-4aba-9d06-d5a92316a1de]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:32 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:33 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 Sep 11 23:20:33 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:33 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4" returned: 0 in 0.341s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:33 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 Sep 11 23:20:33 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:33 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18" returned: 0 in 0.318s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:33 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18 Sep 11 23:20:33 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:33 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4.86839a4c-6620-420f-bb16-6bfaf08cac18" returned: 0 in 0.234s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-86839a4c-6620-420f-bb16-6bfaf08cac18" released by "_delete_snapshot" :: held 1.322s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-ecfe46b7-3a58-4522-939a-5fd57ad514c4" released by "delete_snapshot" :: held 1.343s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Created reservations ['8e32c032-659e-4b52-9de0-e214c0e38183', '7ba1b546-db51-414c-b794-f536bb12a425', '41e23c8f-7be7-4134-b6b2-c6a486fc3327', '7f857643-afba-448f-984a-660d28f828c2'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:33 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Delete snapshot completed successfully. Sep 11 23:20:33 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-f5485401-5cd2-435e-aaea-d1610de06168 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-86839a4c-6620-420f-bb16-6bfaf08cac18-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-ecfe46b7-3a58-4522-939a-5fd57ad514c4-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-ecfe46b7-3a58-4522-939a-5fd57ad514c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-ecfe46b7-3a58-4522-939a-5fd57ad514c4" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:34 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-ecfe46b7-3a58-4522-939a-5fd57ad514c4" acquired by "delete_volume" :: waited 0.016s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:34 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b119af7-d827-4308-b128-8145c84fec91]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:34 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:34 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 Sep 11 23:20:34 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:35 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4" returned: 0 in 0.356s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:35 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4 Sep 11 23:20:35 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:35 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-ecfe46b7-3a58-4522-939a-5fd57ad514c4" returned: 0 in 0.230s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-ecfe46b7-3a58-4522-939a-5fd57ad514c4" released by "delete_volume" :: held 0.639s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Created reservations ['ab0fd01e-ab69-4804-961a-d8a664b13737', '78c48404-5a8f-40ff-90fd-e455aec8e940', 'a2a7578c-994a-4a8f-b49b-95b96ece37a8', '8efd543e-b7da-4fb6-b0d7-5fe9b214be0d'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:35 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:35 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:35 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.242s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:35 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Deleted volume successfully. Sep 11 23:20:35 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-ba1d9698-5dfb-44ec-910e-6608b72f86e6 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-ecfe46b7-3a58-4522-939a-5fd57ad514c4-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (efad4dd4-b77a-4f4c-a83b-4fccc699569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d471d656-251d-4b74-adb1-6967372611e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d471d656-251d-4b74-adb1-6967372611e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725795542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9a1f10-dd13-4afe-86e1-da9bac093d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:36Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a6397e-91a1-46c1-b881-dae58595c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a6397e-91a1-46c1-b881-dae58595c50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ed7ac9-b7c9-4af5-b502-f4fdef4fe582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ed7ac9-b7c9-4af5-b502-f4fdef4fe582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9a1f10-dd13-4afe-86e1-da9bac093d21', 'volume_name': 'volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78853bf-2838-48fb-ad1a-9e1f5d5032b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78853bf-2838-48fb-ad1a-9e1f5d5032b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8f9d2e-dd49-4a68-88fe-d2b66e0a593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:36 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Volume 3c9a1f10-dd13-4afe-86e1-da9bac093d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21', 'volume_size': 1} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725795542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9a1f10-dd13-4afe-86e1-da9bac093d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92c405c35e48209ff5da0902343016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:36Z,use_quota=True,user_id='fccbdda0a74847ff95ecc697f7839466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Creating volume 3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:36 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 1073741824 Sep 11 23:20:36 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 1073741824" returned: 0 in 0.386s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 Sep 11 23:20:36 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21" returned: 0 in 0.237s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8f9d2e-dd49-4a68-88fe-d2b66e0a593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:36 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b581396-bb25-4732-937a-67e1f7ac9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:37 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Volume volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 (3c9a1f10-dd13-4afe-86e1-da9bac093d21): created successfully Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b581396-bb25-4732-937a-67e1f7ac9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Flow 'volume_create_manager' (efad4dd4-b77a-4f4c-a83b-4fccc699569a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:37 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-80a18fb6-06bf-413f-90dc-9a7fde75f661 tempest-ProjectReaderTests-1508849324 None] Created volume successfully. Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Creating offline snapshot 7a8dc624-d981-4e98-b328-b807be75b0d1 of volume 3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c728dc-feb5-42ad-8223-aaa697ba9e41]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 Sep 11 23:20:37 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:37 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21" returned: 0 in 0.327s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:37 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 1G {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 1G Sep 11 23:20:37 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 1G" returned: 0 in 0.354s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:38 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 Sep 11 23:20:38 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 -F qcow2 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1" returned: 0 in 0.258s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 is being set with open permissions: ugo+rw Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:38 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 Sep 11 23:20:38 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1" returned: 0 in 0.228s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:38 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info Sep 11 23:20:38 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info" returned: 0 in 0.233s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88002]: WARNING cinder.volume.drivers.remotefs [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info is being set with open permissions: ugo+rw Sep 11 23:20:38 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:38 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info Sep 11 23:20:38 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.info" returned: 0 in 0.220s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.691s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:39 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-0ffe109e-b136-48f9-b640-e0e078dda13c tempest-ProjectReaderTests-1508849324 None] Create snapshot completed successfully Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-7a8dc624-d981-4e98-b328-b807be75b0d1-delete_snapshot" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-7a8dc624-d981-4e98-b328-b807be75b0d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-3c9a1f10-dd13-4afe-86e1-da9bac093d21" by "delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-3c9a1f10-dd13-4afe-86e1-da9bac093d21" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-7a8dc624-d981-4e98-b328-b807be75b0d1" by "_delete_snapshot" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-7a8dc624-d981-4e98-b328-b807be75b0d1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Deleting offline snapshot 7a8dc624-d981-4e98-b328-b807be75b0d1 of volume 3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] snapshot_file for this snap is: volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 {{(pid=88002) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2057d6-2f8f-4681-9dab-cb98724b90d5]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 Sep 11 23:20:39 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1" returned: 0 in 0.330s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88002) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee61d0-30a3-40e8-be58-5eee9c01679c]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:39 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:40 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 Sep 11 23:20:40 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:40 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21" returned: 0 in 0.331s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:40 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 Sep 11 23:20:40 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:40 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1" returned: 0 in 0.316s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:40 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1 Sep 11 23:20:40 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:40 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21.7a8dc624-d981-4e98-b328-b807be75b0d1" returned: 0 in 0.238s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-7a8dc624-d981-4e98-b328-b807be75b0d1" released by "_delete_snapshot" :: held 1.297s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-3c9a1f10-dd13-4afe-86e1-da9bac093d21" released by "delete_snapshot" :: held 1.316s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Created reservations ['da8c9dbf-7fb5-4270-9653-8143998140a8', '77ccc06e-9f98-4b36-8767-19ff9d5c6ad2', '19b009b1-b992-4c35-8d42-a2106fc1ddc7', '9c50a3b7-fb17-4b31-a080-9da229fb04d8'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:40 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Delete snapshot completed successfully. Sep 11 23:20:40 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-908e3f40-d6a4-4e3d-8f74-ee582c5bd619 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-7a8dc624-d981-4e98-b328-b807be75b0d1-delete_snapshot" released by "delete_snapshot" :: held 1.446s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-3c9a1f10-dd13-4afe-86e1-da9bac093d21-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-3c9a1f10-dd13-4afe-86e1-da9bac093d21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "cinder-quobyte-3c9a1f10-dd13-4afe-86e1-da9bac093d21" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:41 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-3c9a1f10-dd13-4afe-86e1-da9bac093d21" acquired by "delete_volume" :: waited 0.015s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:41 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6fae73-ff25-4644-9ecd-7a189aa5ab82]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:41 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:41 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 Sep 11 23:20:41 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:42 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21" returned: 0 in 0.369s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:42 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21 Sep 11 23:20:42 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:42 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-3c9a1f10-dd13-4afe-86e1-da9bac093d21" returned: 0 in 0.249s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-quobyte-3c9a1f10-dd13-4afe-86e1-da9bac093d21" released by "delete_volume" :: held 0.670s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Created reservations ['7b9459f0-b723-4cb3-ad0c-0ff5a3dba0b1', 'b6a52be5-25df-425c-ba6f-726f8f312888', '986024a9-11c7-41e4-b1b9-3ac300cf6838', '1ff65b7d-47a8-476b-be74-e0d97e84db32'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:42 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:42 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:42 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.244s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:42 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Deleted volume successfully. Sep 11 23:20:42 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8ed630b6-5b2c-4e40-8f69-c7e90e751923 tempest-ProjectReaderTests-1508849324 None] Lock "cinder-3c9a1f10-dd13-4afe-86e1-da9bac093d21-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Flow 'volume_create_manager' (638dd4b1-bd52-45c7-a56e-3b028ffb09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e7e35-fc58-4a4a-a70c-2a0848abe10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e7e35-fc58-4a4a-a70c-2a0848abe10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275830811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9a659dd4bb4b24bae32bd4672caa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:46Z,use_quota=True,user_id='589de2e3d53645f2a983d1814a9aa7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5853f846-709e-426c-a577-401ceca6c01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5853f846-709e-426c-a577-401ceca6c01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e07418f-76b9-4da3-b266-0b54af8af017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e07418f-76b9-4da3-b266-0b54af8af017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e', 'volume_name': 'volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dad9695-e0e0-4173-a62a-399c17678dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dad9695-e0e0-4173-a62a-399c17678dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b101e8-2c36-4032-9298-49ab29344d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:46 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Volume 0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e', 'volume_size': 1} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275830811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9a659dd4bb4b24bae32bd4672caa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:46Z,use_quota=True,user_id='589de2e3d53645f2a983d1814a9aa7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Creating volume 0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:46 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:46 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e 1073741824 Sep 11 23:20:46 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:46 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e 1073741824" returned: 0 in 0.406s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:46 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:46 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e Sep 11 23:20:46 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e" returned: 0 in 0.241s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=107,cinder:INSERT=41,cinder:UPDATE=146,cinder:DELETE=16 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b101e8-2c36-4032-9298-49ab29344d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6b219d-3594-40bc-8563-0b3a54a21eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:47 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Volume volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e (0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e): created successfully Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6b219d-3594-40bc-8563-0b3a54a21eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Flow 'volume_create_manager' (638dd4b1-bd52-45c7-a56e-3b028ffb09a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:47 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-041f04f6-fe36-4fe4-a32e-c26d8357549e tempest-ProjectReaderTests-1252908673 None] Created volume successfully. Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Acquiring lock "cinder-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Lock "cinder-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Acquiring lock "cinder-quobyte-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Lock "cinder-quobyte-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e" acquired by "delete_volume" :: waited 0.013s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504df17-8b59-4cda-8935-4835edf2bc06]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e Sep 11 23:20:47 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e" returned: 0 in 0.349s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e Sep 11 23:20:47 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:48 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e" returned: 0 in 0.227s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Lock "cinder-quobyte-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e" released by "delete_volume" :: held 0.613s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Created reservations ['3ded3bc1-82ad-4aa4-b787-7dde68964006', 'd32cb489-b4c7-42ef-ad83-3abda1c7e4a3', '1abc5167-cd29-426e-b03a-5db1a23b2561', 'd2cdd287-6f18-442c-8a50-799fd663f47b'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:48 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:48 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:48 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.236s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:48 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Deleted volume successfully. Sep 11 23:20:48 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-10ecd445-cdf4-4592-aecf-e312ae221787 tempest-ProjectReaderTests-1252908673 None] Lock "cinder-0cd29ca0-746d-4d62-bbd5-8691ff1e4a2e-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Flow 'volume_create_manager' (6588c3ce-1c11-460f-b6c5-39c21f0227e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a686b6-0e22-4214-a28b-a542b5692a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=117,cinder:INSERT=40,cinder:UPDATE=147,cinder:DELETE=8 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a686b6-0e22-4214-a28b-a542b5692a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2036957512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4786e958-654e-4421-8a76-096d0ef141d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9a659dd4bb4b24bae32bd4672caa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:49Z,use_quota=True,user_id='589de2e3d53645f2a983d1814a9aa7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11647749-e6b2-4a99-89e2-6e2db69db804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11647749-e6b2-4a99-89e2-6e2db69db804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c403b30-a232-455c-9dde-b3bee1b1892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c403b30-a232-455c-9dde-b3bee1b1892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4786e958-654e-4421-8a76-096d0ef141d7', 'volume_name': 'volume-4786e958-654e-4421-8a76-096d0ef141d7', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d05339-b3b8-4608-a40a-a0d1ab36c658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d05339-b3b8-4608-a40a-a0d1ab36c658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9022a06f-495e-4624-9c93-017c184b238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Volume 4786e958-654e-4421-8a76-096d0ef141d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4786e958-654e-4421-8a76-096d0ef141d7', 'volume_size': 1} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2036957512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4786e958-654e-4421-8a76-096d0ef141d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9a659dd4bb4b24bae32bd4672caa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:49Z,use_quota=True,user_id='589de2e3d53645f2a983d1814a9aa7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e1539-3747-4b08-a3a2-4e1a5062068f),volume_type_id=8b2e1539-3747-4b08-a3a2-4e1a5062068f)}" {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.remotefs [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Creating volume 4786e958-654e-4421-8a76-096d0ef141d7 {{(pid=88002) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Selected osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd as target Quobyte volume. {{(pid=88002) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:49 devstack cinder-volume[88002]: INFO cinder.volume.drivers.remotefs [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] casted to osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 1073741824 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:49 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 1073741824 Sep 11 23:20:49 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:49 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 1073741824" returned: 0 in 0.399s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:49 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 Sep 11 23:20:49 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:49 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7" returned: 0 in 0.243s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'} {{(pid=88002) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9022a06f-495e-4624-9c93-017c184b238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4786e958-654e-4421-8a76-096d0ef141d7', 'volume_size': 1}' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a91f32b-94d6-4ffe-8884-e7be5aa887f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88002]: INFO cinder.volume.flows.manager.create_volume [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Volume volume-4786e958-654e-4421-8a76-096d0ef141d7 (4786e958-654e-4421-8a76-096d0ef141d7): created successfully Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a91f32b-94d6-4ffe-8884-e7be5aa887f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88002) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Flow 'volume_create_manager' (6588c3ce-1c11-460f-b6c5-39c21f0227e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88002) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:49 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-fc350698-1589-4e37-ad38-5b832dbdea30 tempest-ProjectReaderTests-1252908673 None] Created volume successfully. Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Acquiring lock "cinder-4786e958-654e-4421-8a76-096d0ef141d7-delete_volume" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Lock "cinder-4786e958-654e-4421-8a76-096d0ef141d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Acquiring lock "cinder-quobyte-4786e958-654e-4421-8a76-096d0ef141d7" by "delete_volume" {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Lock "cinder-quobyte-4786e958-654e-4421-8a76-096d0ef141d7" acquired by "delete_volume" :: waited 0.014s {{(pid=88002) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb2ba0-a1ff-4b48-8deb-0d9778f92c7b]: (4, 'qcow2') {{(pid=89656) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 Sep 11 23:20:50 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7" returned: 0 in 0.339s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7 Sep 11 23:20:50 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca/volume-4786e958-654e-4421-8a76-096d0ef141d7" returned: 0 in 0.235s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Lock "cinder-quobyte-4786e958-654e-4421-8a76-096d0ef141d7" released by "delete_volume" :: held 0.606s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.quota [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Created reservations ['dc97f7ca-3571-45db-83d8-16568a03a7da', '1e8324a8-2a0e-4fac-aa5c-73d36fdd2f82', 'a2529568-c3c7-4605-9bc9-004cbcc64548', 'dc71afe6-f273-4647-8a95-3cccc64812f5'] {{(pid=88002) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:50 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:50 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:51 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:51 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.233s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:51 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:51 devstack cinder-volume[88002]: INFO cinder.volume.manager [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Deleted volume successfully. Sep 11 23:20:51 devstack cinder-volume[88002]: DEBUG cinder.coordination [None req-8b0d3b50-ce7e-415a-b6c5-0c267ba57c5f tempest-ProjectReaderTests-1252908673 None] Lock "cinder-4786e958-654e-4421-8a76-096d0ef141d7-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=88002) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd': None} {{(pid=88002) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4f0dba0e-20e6-42f4-834c-69e483cdb4cd'] {{(pid=88002) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.lockutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88002) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:59 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca Sep 11 23:20:59 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:59 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_concurrency.processutils [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/886ba2ded0859921598ff48dcb07e3ca" returned: 0 in 0.235s {{(pid=88002) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG cinder.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Notifying Schedulers of capabilities ... {{(pid=88002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG oslo_service.periodic_task [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] Running periodic task VolumeManager._thread_info {{(pid=88002) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread count: 29 {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:20:59 devstack cinder-volume[88002]: DEBUG cinder.volume.manager [None req-c3dcec8d-a50d-4cf2-bf86-5a970559dec5 None None] thread info: [<_MainThread(MainThread, started 132286924968064)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88002) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:21:00 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:21:01 devstack cinder-volume[88002]: DEBUG dbcounter [-] [88002] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88002) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}